eschaton_dbms_eval
Grades SQL database queries across SQLite, PostgreSQL, MySQL, and Oracle by seeding an ephemeral database per testcase and comparing query output against expected results.
Instructions
Automated SQL database grading across SQLite, PostgreSQL, MySQL, and Oracle: seeds an ephemeral database per testcase with schema_sql DDL/DML and evaluates queries.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"source_code": "<source_code>",
"schema_sql": "<schema_sql>"
},
"name": "eschaton_dbms_eval"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| stdin | No | Optional standard input | |
| database | No | Database engine backend | sqlite |
| schema_sql | Yes | DDL/DML SQL statements to seed the test database | |
| source_code | Yes | Python database query/app code | |
| expected_output | No | Expected query stdout |