Skip to main content
Glama
imjszhang

Open Science MCP

by imjszhang

start_run

Idempotent

Start or continue a research run in Open Science by submitting a prompt and project ID, receiving a run ID to monitor progress.

Instructions

Submit research (may incur model cost), or continue an existing session. cwd must match the session directory on follow-ups. Approvals stay in Open Science UI. Returns a run ID; poll/wait on that ID. Same-key retries are protected only in the same daemon lifetime within 24 hours of the first request; inspect original runs/sessions after restart or expiry.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
cwdNo
promptYes
project_idYes
session_idNo
turn_intentNo
idempotency_keyYesGenerate once per intended operation (for example a UUID). Same-key/same-argument replay is protected only in the same Open Science daemon lifetime, within 24 hours of the first request. After restart, expiry, or uncertain instance identity, inspect existing IDs and UI before deciding whether to retry.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the annotations (readOnly=false, idempotentHint=true), the description discloses model cost, approval persistence in the Open Science UI, and the narrow idempotency guarantee tied to daemon lifetime and a 24-hour window. This materially changes how an agent should reason about retries and side effects, and it does not contradict the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three dense sentences carry high-value information: cost, session continuity, cwd constraint, approval behavior, return value, and idempotency limits. There is no filler or repetition of schema content.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has six parameters, no output schema, and meaningful side effects, the description covers the critical operational facts: cost, approvals, run ID return, cwd constraint, and retry protection limits. It is slightly weak on how to discover or supply session_id and what turn_intent='plan-first' implies, but it is largely sufficient for correct invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is only 17%, so the description must compensate. It adds meaning for cwd (must match the session directory), session_id (continue an existing session), and idempotency_key (retry limitations), but it does not clarify project_id, prompt, or turn_intent, leaving some parameter semantics to inference.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names two distinct actions: submitting research and continuing an existing session, with a clear resource (a run). It implicitly distinguishes itself from read-only siblings like get_run, wait_run, and list_sessions by focusing on submission/continuation, so an agent can tell when to select it.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives concrete usage context: start a new submission or continue a session, and requires cwd to match the session directory on follow-ups. It also directs the agent to poll/wait on the returned run ID, suggesting the appropriate follow-up tools, though it does not explicitly name alternatives or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.