Skip to main content
Glama

nogpu-mcp

MCP server that lets your agent measure, on your own data, how many of your LLM's classification or routing decisions a small CPU model can take alone. It calls the free NoGPU report.

Tools:

  • nogpu_report(path, source?, calls_per_day?, usd_per_1k_calls?): uploads a file of {"text": ..., "label": ...} rows (JSONL, a JSON array, or a CSV with text and label columns; 160 to 10,000 rows, at least 2 labels) and returns, usually in 15-60 seconds: a fit / not-fit verdict, the share the CPU model answers alone, how often it then matches your LLM with a one-sided 95% Clopper-Pearson lower bound (held-out rows), latency, the row counts, what the upload check changed, and a link to the report. Keeping the model is $99 one-time per model (a new label set is a new upload and a new model); the report is free. source (history, logging or file, the default) is sent as the X-NoGPU-Source header so NoGPU can count where reports come from. calls_per_day and usd_per_1k_calls (your estimate) are added to the report link so its savings calculator starts from your numbers.

  • nogpu_buy(job_id, claim_token): read-only, never pays. For a fit report it returns the $99 offer, the yes/no question to ask you, a card checkout link for you to open, and the USDC (x402) payment details when the server offers them; for any other job, the reason it can't be bought. The plugin's skill pays only after your explicit yes.

  • nogpu_delete(job_id, claim_token): deletes the uploaded data now (otherwise deleted within 24 hours; 24 hours after payment if you buy).

Measured example (3,000 rows of the public Banking77 set, 77 intents): 66.7% answered alone, matching the dataset's labels 94.1% of the time when it answered (95% lower bound 91.4%), about 5 ms per decision.

Raw LLM logs (OpenAI, Anthropic, Langfuse, LangSmith, Helicone)? Convert them locally first with nogpu_export.py (Python stdlib only).

Install

Claude Code:

claude mcp add nogpu -- npx -y github:doronp/nogpu-mcp

Any MCP client (Claude Desktop, Cursor, ...):

{ "mcpServers": { "nogpu": { "command": "npx", "args": ["-y", "github:doronp/nogpu-mcp"] } } }

Then ask your agent: "Run a NoGPU report on ./decisions.jsonl".

Related MCP server: EvalForge Lite

As a Claude Code plugin

claude plugin marketplace add doronp/nogpu-mcp
claude plugin install nogpu@nogpu

Then ask: "get me a NoGPU report for this app". The plugin adds this MCP server (npx -y github:doronp/nogpu-mcp#v0.2.0) and one skill. The skill has your coding agent find the recurring LLM classification call in your repo, follow its result to where the app already stores it (a database column, a log, an observability export), and write a local extraction script that creates nogpu.jsonl and prints only the row count and label histogram. With no stored history, it adds a local logger at the call site (collect.mjs for the AI SDK, a few lines in other languages) so rows build up. After you buy the model, ask "install my NoGPU model": the skill downloads it with your claim token and puts it in front of the call site, with your LLM as the fallback.

Data

  • Uploaded: only the file you approve, {"text", "label"} rows, sent by nogpu_report (or curl) to https://nogpu.dev/api/jobs, used to train and test a CPU model for your report.

  • No row reaches nogpu.dev before you say yes: the skill shows the file path, row count and label histogram, and asks first. The logger and the extraction script only write local files.

  • Your coding agent's model provider sees what the agent reads, as always: code, schemas, counts and label names. The skill tells the agent never to print row text.

  • Deleted within 24 hours (if you buy the model, within 24 hours of payment), or at once with nogpu_delete(job_id, claim_token).

  • The skill tells the agent to read schemas and counts and never print rows into the conversation. That is an instruction to the agent, not something the plugin enforces.

API reference: https://nogpu.dev/openapi.json · MIT license.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      Not graded
      quality
      C
      maintenance
      Enables LLM evaluation and observability by uploading documents, building test sets, running RAG pipelines, and automatically scoring answers for groundedness, hallucination risk, retrieval quality, latency, and cost, with tools exposed to MCP-compatible clients.
      1
      MIT
    • A
      license
      A
      quality
      B
      maintenance
      Lets assistants send the same test prompts to as many as four text models across OpenRouter, Amazon Bedrock, Google Vertex AI and Microsoft Foundry, then automatically grade each answer with a judge model, rule checks and a policy gate. Returns scored leaderboards with letter grades, per-response strengths and weaknesses, latency, throughput and estimated cost, plus downloadable PDF and CSV reports.
      9
      30 PyPI
      MIT
    • A
      license
      Not graded
      quality
      B
      maintenance
      Enables assistants to queue and monitor local language and vision model evaluations, compare results with confidence intervals, and retrieve routing recommendations for task categories.
      MIT
    • A
      license
      Not graded
      quality
      B
      maintenance
      Enables agents to turn a real model failure into a deterministic benchmark task by forging it with exact assertions, grading the task itself across six weighted factors, and inspecting a tamper-evident SHA-384 audit trail. Exposes eleven typed JSON-RPC 2.0 tools that call the same idempotent service layer as the UI, so mutations and decisions stay sealed and reproducible.
      MIT