Search public Codabench competitions. Auto-paginates up to max_pages.

Get full details of a single Codabench competition.

List all phases of a Codabench competition.

Get full details of a single phase.

Get a competition's rules, terms, evaluation criteria, and any other descriptive pages concatenated into a single markdown string.

List all tasks attached to a Codabench competition.

Get full details of a single task, including dataset keys.

Get the leaderboard for a phase.

Get the authenticated user's Codabench profile.

Download a Codabench dataset/bundle to a local absolute path. Streams directly to disk and returns the SHA-256. Refuses to overwrite unless overwrite=True.

List the authenticated user's submissions, newest first.

Get full details of a submission including scores.

Get stdout/stderr/ingestion logs for a submission.

Submit a zipped model bundle to a competition phase. Performs Codabench's 3-step upload: POST /api/data/, PUT to signed URL, PUT /api/data/upload_completed/, POST /api/submissions/.

Poll a submission until it reaches a terminal state (finished/failed/cancelled) or timeout_seconds elapses. Returns the final submission record, or {status: 'still_running'} on timeout — the agent can choose to poll again.

Generic Codabench REST escape hatch. Use when no curated tool fits. Path must start with '/api/'. By default only GET/HEAD/OPTIONS are allowed; start the server with CODABENCH_ALLOW_WRITE_RAW=1 to permit POST/PUT/PATCH/DELETE.