#abstention

Teaching a data agent to say I don't know, and why that is hard

On a benchmark that prices wrong SQL, abstaining from everything scores 50% and the best real systems score 29.8% to 54.5%.