assess_repo_reproducibility
Evaluates a GitHub repository's reproducibility without cloning or executing code, returning a verdict and weighted signals like README quality, dependencies, and maintenance.
Instructions
Heuristic, no-clone reproducibility assessment of a GitHub repo.
Returns a verdict (likely-reproducible / partial / unlikely / insufficient-info) plus weighted signals: README quality, dependency files, fixture data, notebooks, figure-generating scripts, recent maintenance, license. No code is downloaded or executed. Set GITHUB_TOKEN to raise the API rate limit.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"repo_url": "<repo_url>"
},
"name": "assess_repo_reproducibility"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| paper_id | No | ||
| repo_url | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| notes | Yes | ||
| signals | No | ||
| verdict | Yes | ||
| paper_id | No | ||
| repo_url | Yes | ||
| overall_score | Yes | ||
| recommended_entrypoint | No | E.g. 'python make_figures.py' if a likely figure-generating script was found. |