Skip to main content
Glama
Rishab-Ghosh

Reviewer Zero

by Rishab-Ghosh

verify_quotes

Check that quotes from a paper appear word for word in its PDF and identify the page. Run it on every quote before citing it in a review.

Instructions

Check that quotes you intend to cite from a paper appear in its PDF word for word, and on which page. Use it on every quote before putting it in a review: a quote that is not verified must not be presented as the paper's text. Whitespace, line-break hyphenation, ligatures and punctuation are forgiven; added, dropped or changed words are not. Join separate fragments with "..." only when they appear in order, close together. Quotes need at least 5 words. Up to 50 quotes per call. Local only: nothing is sent anywhere.

Privacy: runs on your machine. Your PDF and its text never leave it, except to Anthropic under your own API key when you call review_paper. What is sent: search queries and paper keys to the Reviewer Zero index (it counts requests per API key and stores nothing else), and, for check_citations, the titles, DOIs and arXiv ids of the works the paper cites, to the index and to OpenAlex, Crossref and arXiv. No telemetry.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
quotesYes
pdf_pathYes

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
quotesYes
n_verifiedYes
text_engineYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.1.0

TDQS

A4.1/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden and does so richly: it discloses matching tolerance (whitespace, hyphenation, ligatures, punctuation forgiven; word changes not), fragment-joining rules, a 5-word floor, a 50-quote cap, and that the operation is local-only. This is exactly the behavioral context an agent needs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The purpose and matching rules are front-loaded and every sentence in the first block earns its place. The privacy paragraph is long and spends several sentences on other tools' data flows (review_paper, check_citations), which is tangential to invoking this tool, though the local-only claim itself is valuable.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return values need not be explained. For a two-parameter verification tool, the description supplies matching semantics, limits, workflow placement, and privacy posture — everything needed to call it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 0%, so the description must compensate. It adds substantial meaning for `quotes` (minimum 5 words, max 50 per call, join fragments with '...' in order), but says nothing about `pdf_path` (format, absolute vs relative). Half the parameters remain undocumented in both schema and description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a precise verb and resource: 'Check that quotes you intend to cite from a paper appear in its PDF word for word, and on which page.' An agent immediately knows this verifies quote fidelity against a PDF. However, it never explicitly contrasts itself with siblings like check_citations or check_format, so routing relies on the reader inferring the distinction.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives a clear usage trigger: 'Use it on every quote before putting it in a review: a quote that is not verified must not be presented as the paper's text.' This tells the agent when to reach for the tool. It stops short of naming an alternative tool or an explicit when-not case, so it is strong context without full routing guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.