SQLMorph: Query Mutation and Fine-Grained Metrics for Text-to-SQL Evaluation
SQLMorph's query mutation and fine-grained metrics support debugging and better align Text-to-SQL evaluation practices with real-world deployments, and introduces a family of execution-level metrics that address the limitations of current binary measures.
Mohammadhossein Malekpour, M. Riahi, Maxime Lamothe et al.
· IEEE International Conferenc... · 1 citation