eschaton_fileio_eval
Seeds input files into an isolated filesystem sandbox, runs learner file I/O code, and grades the generated output file against expected content.
Instructions
Isolated filesystem sandbox grading: seeds input files into sandbox disk, runs learner code that reads/writes files, and grades generated output file.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"source_code": "<source_code>"
},
"name": "eschaton_fileio_eval"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| language_id | No | Language ID | |
| source_code | Yes | Source code performing file I/O | |
| input_content | No | Content of input file | DATA |
| input_filename | No | Input file name to seed | input.txt |
| expected_output | No | Expected content of the output file | |
| output_filename | No | Expected output file to read and grade | output.txt |