Validate an eval config
modelfinder_validate_eval_configValidate an eval config pre-run: checks schema, no embedded keys, HTTPS endpoints, placeholders, and valid checks. Reports API calls, env vars, unpriced models, and personal-data guard status.
Instructions
Check an eval config before running: schema, no keys in the config, HTTPS endpoints, no template placeholders, valid checks. Reports API call count, required environment variable names, unpriced models, and whether the personal-data guard would block the run. Makes no network calls.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| config | Yes | The eval config object (as saved for eval_models.py). | |
| response_format | No | markdown (default) for a readable summary, json for the full machine-readable result. | markdown |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| valid | Yes |