Get one AI benchmark with its SOTA and model scores
get_benchmarkRetrieve one benchmark by slug or name to see what it measures, its state of the art, saturation, human baseline, model scores, and the profession rankings that rely on it.
Instructions
Get one benchmark by slug or name: what it measures, state of the art, saturation, headroom, human baseline, source and notes, the radar axis it informs, the model scores recorded on it, and which profession rankings use it. Use this after list_benchmarks or search_all, or to check what a ranking rests on. Cite canonical_url with dataset_version.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| slug | Yes | Benchmark slug from list_benchmarks (e.g. 'swe-bench-pro') or its exact name. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| list | Yes | ||
| name | Yes | ||
| slug | Yes | ||
| radar | Yes | ||
| citation | Yes | ||
| model_scores | Yes | ||
| resource_uri | Yes | ||
| canonical_url | Yes | Cite this URL with dataset_version. | |
| dataset_version | Yes | ||
| used_by_professions | Yes | ||
| comparable_across_labs | Yes |