evaluate_queries
Add test cases with natural language questions and ground truth SQL, run evaluations to check generated SQL accuracy, and view results.
Instructions
Manage SQL accuracy evaluation. Add/list test cases, run evaluations, and view results.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| data_source_id | Yes | Data source ID | |
| action | Yes | Action to perform | |
| test_case | No | Test case to add (required when action=add_test) | |
| test_case_id | No | Test case ID to remove (required when action=remove_test) | |
| generated_sqls | No | List of SQL to evaluate (required when action=run) |