The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators
SQL has been augmented with AI operators, enabling modern data analytics platforms to derive insights from both structured and unstructured data. We observe that while current Text-to-SQL systems can successfully generate these AI-augmented queries, reliably evaluating their correctness remains a critical open challeng...