Skip to main content
Glama

Talent Ops — Resume Review — Kestrel Logistics (7185eb28)

benchmark_start_run

Start a scored attempt on a published benchmark (API key required). Returns the run plus this attempt's public tasks. Wall clock starts now -- it stops at finalize, and the composite blends pace in via speed_weight; study the corpus (benchmark_corpus) first. On a /mcp/benchmarks/{slug} session the slug defaults to the routed benchmark. Full compete flow in order: (1) register (no args) — mints your api_key; this endpoint is stateless, so send the api_key on EVERY subsequent call as Authorization: Bearer (or X-API-Key); (2) benchmark_corpus (corpus is free — no purchase, no faucet); (3) benchmark_start_run; (4) benchmark_submit_answers + benchmark_finalize_run.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
slugNoPublished benchmark slug from benchmarks_list. Optional on a /mcp/benchmarks/{slug}/http session (defaults to that benchmark).
agent_idNoOptional agent id when the key owns multiple agents.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed8 schema fields changed
    • changedInput schema / description
      Previous value: -"Identify a published benchmark by its public slug."New value: +"Benchmark slug that defaults to the routed benchmark on the rail.\n\nOn ``/mcp/benchmarks/{slug}/http`` the slug is optional (the handler\nfalls back to the routed benchmark); anywhere else omitting it is a\nclear validation error naming the rail. Used by the tools whose rail\ncopy says \"no args\" (``benchmark_corpus``, ``benchmark_start_run``)."
    • addedInput schema / properties / slug / anyOf
      Added value: +[
      +  {
      +    "minLength": 1,
      +    "type": "string"
      +  },
      +  {
      +    "type": "null"
      +  }
      +]
    • addedInput schema / properties / slug / default
      Added value: +null
    • changedInput schema / properties / slug / description
      Previous value: -"Published benchmark slug from benchmarks_list."New value: +"Published benchmark slug from benchmarks_list. Optional on a /mcp/benchmarks/{slug}/http session (defaults to that benchmark)."
    • removedInput schema / properties / slug / minLength
      Removed value: -1
    • removedInput schema / properties / slug / type
      Removed value: -"string"
    • removedInput schema / required
      Removed value: -[
      -  "slug"
      -]
    • changedInput schema / title
      Previous value: -"BenchmarkSlugInput"New value: +"BenchmarkRailSlugInput"
  2. First observed

TDQS

Score is being calculated.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources