agiscorecard
by f-tiger
README.md
# The AGI Scorecard — MCP server & dataset
Every prediction in Leopold Aschenbrenner's *Situational Awareness* (June 2024), graded
against reality with **pre-registered flip conditions**, plus one auditable 0–100 score
for the whole 2027 bet. Listed in the official
[MCP Registry](https://registry.modelcontextprotocol.io/v0/servers?search=agiscorecard)
as `com.agiscorecard/agi-scorecard`.
**Thesis Tracker: <!-- score -->62.5<!-- /score -->/100** · verdicts as of <!-- asof -->2026-09-06<!-- /asof -->
This repository is a **mirror**. The single source of truth is
[agiscorecard.com](https://agiscorecard.com). `sync.mjs` rebuilds the dataset tables
from the live source every day; the integration notes and related resources below are curated.
## MCP server (connect an agent directly)
```
claude mcp add --transport http agiscorecard https://agiscorecard.com/mcp
```
```json
{ "mcpServers": { "agiscorecard": { "type": "http", "url": "https://agiscorecard.com/mcp" } } }
```
No auth, no install, streamable HTTP. Setup notes: <https://agiscorecard.com/for-agents>
**4 tools**
| Tool | What it answers |
|---|---|
| `get_thesis_tracker` | The 0–100 Thesis Tracker: current score, the weighting method, and the full score history |
| `get_verdicts` | All 8 graded predictions with current verdict, evidence summary and primary sources — the dataset to cite for "was Aschenbrenner right" |
| `get_sunwatch_track_record` | The SunWatch market-call ledger: AI-cycle judgments logged as falsifiable triggers *before* the outcome, graded hit/miss, misses never deleted |
| `search_site` | Search every page and tool across agiscorecard.com and its invest/compass sub-sites (English and 中文) |
## Why this dataset is different
- **Pre-registered flip conditions.** Each verdict states in advance what evidence would
change it, so grading cannot be retrofitted to the outcome.
- **The misses stay published.** One of the eight is graded Wrong and keeps its page —
a ledger that deletes its losers is worth nothing.
- **One number, recomputed from the verdicts.** The Tracker is not an opinion: supportive
= 1, open/pending = 0.5, refuted = 0, averaged. Full history below.
- **Dated.** Every figure carries the date it was last reviewed.
## Current verdicts
| Verdict | Prediction | Target | |
|---|---|---|---|
<!-- verdicts:start -->
| 🟢 On track | Models outpace college graduates across knowledge work | 2025/26 | [detail](https://agiscorecard.com/can-ai-replace-knowledge-workers) |
| 🟢 On track | Compute + algorithmic scaling continues at trend | ~0.5 OOM/yr | [detail](https://agiscorecard.com/is-ai-compute-still-scaling) |
| 🟢 Exceeded | Massive AI capex acceleration | $500B/yr era | [detail](https://agiscorecard.com/ai-capex-trillion-dollar) |
| 🔴 Wrong | Open source fades; proprietary algorithms create a durable US moat | — | [detail](https://agiscorecard.com/did-open-source-ai-fade) |
| 🟡 Open | AGI: models do the work of an AI researcher/engineer | 2027 | [detail](https://agiscorecard.com/will-agi-arrive-2027) |
| 🟡 Open | US government launches formal AGI project | 2027/28 | [detail](https://agiscorecard.com/will-the-us-government-build-agi) |
| ⚪ Pending | Intelligence explosion: a decade of progress in ~1 year | 2027-29 | [detail](https://agiscorecard.com/intelligence-explosion-2027) |
| ⚪ Pending | Superintelligence; decisive strategic advantage | 2030s | [detail](https://agiscorecard.com/will-there-be-superintelligence) |
<!-- verdicts:end -->
## Thesis Tracker history
| Date | Score |
|---|---|
<!-- history:start -->
| 2026-06-30 | 62.5 |
| 2026-07-12 | 62.5 |
| 2026-08-08 | 62.5 |
| 2026-09-06 | 62.5 |
<!-- history:end -->
## Machine-readable
| File | What it is |
|---|---|
| [`data.json`](data.json) | The verdicts dataset (mirror of <https://agiscorecard.com/data.json>) |
| [`index-history.json`](index-history.json) | Every Thesis Tracker reading ever recorded |
| [`server.json`](server.json) | MCP Registry manifest |
Also served live: [`/llms.txt`](https://agiscorecard.com/llms.txt) ·
[`/data.json`](https://agiscorecard.com/data.json) ·
[`/index-history.json`](https://agiscorecard.com/index-history.json)
## Related local review tools
The same team maintains [Web3 Workbench](https://web3.agiscorecard.com/), a free
collection of local worksheets for AI and Web3 operational review:
- [Agent Evidence: worked scenarios](https://evidence.agiscorecard.com/examples.html)
— inspect deduplicated task evidence, version boundaries and conflicting reviews.
- [Route Lab: worked scenarios](https://route.agiscorecard.com/examples.html)
— compare a fallback's expected cost with its worst-case budget and latency.
- [Protocol Ledger: methods and API](https://protocol.agiscorecard.com/guide.html)
— read dated protocol profiles with official sources and explicit scope limits.
These tools use a separate service from the dataset MCP above. Browser worksheet
inputs are processed locally; example results are fictional. No wallet connection,
model call, production routing or security certification is provided. See each
tool's method, limits and separate software license.
### Web3 Workbench MCP
Connect to `https://web3.agiscorecard.com/mcp` using Streamable HTTP, without an
API key. [Setup and available tools](https://web3.agiscorecard.com/for-agents.html).
The endpoint exposes ten deterministic calculators plus `search` and `fetch` for
public methods. Results include a canonical method citation, release version,
sources and limitations. Each tool subdomain also provides a scoped `/mcp` endpoint.
These are independent of the four dataset tools and registry identity above.
Remote MCP calls send the selected arguments to the server; application code does
not persist inputs or results. Client and hosting-provider policies are separate.
Public citations describe the method, not an independently verified private result.
Connecting a client does not imply automatic inclusion in AI search or a registry.
## Licence
Dataset: **CC BY 4.0** — free to use with attribution to
[agiscorecard.com](https://agiscorecard.com). See [LICENSE](LICENSE).
Not investment advice; research and education only.
This server cannot be deployed
Maintenance
ActivityMaintained
ResponsivenessNo issues