Agent Reliability
Server Details
Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-11-25
- URL
- Repository
- citarium/agentreliability-mcp
- GitHub Stars
- 0
- Server Listing
- Agent Reliability MCP server
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 9 tools
Each tool has a clearly distinct retrieval purpose: answer for direct QA, search for raw candidate retrieval, get_entity for single-object lookup, compare for multi-object comparison, get_related for graph traversal, get_topic for tag browsing, get_latest for freshness, get_overview for corpus stats, and get_sources for source registry lookup. Even the potentially overlapping search and answer are explicitly differentiated by whether the agent wants a synthesized answer or raw candidates.
The get_* prefix is used consistently for resource-oriented retrieval tools (get_entity, get_related, get_sources, get_topic, get_overview, get_latest), while answer, compare, and search are bare action verbs for query-style operations. This is a coherent convention, though get_latest and get_overview are slightly less noun-like than the other get_* tools.
Nine tools form a well-scoped read-only knowledge-graph API: every major access pattern has a dedicated tool and there is no bloat or redundancy. The count is appropriate for the server's purpose.
The tool set covers the full read-only lifecycle: corpus orientation (get_overview), discovery (search, get_latest, get_topic), object inspection (get_entity), comparison (compare), graph traversal (get_related), and source verification (get_sources). Write/admin operations appear out of scope for an agent-reliability retrieval server, so there are no meaningful gaps.
Available Tools
9 toolsanswerAnswer a question about Agent ReliabilityARead-onlyIdempotentInspect
Answer a question from the corpus, or refuse. Returns only the claims that bear on the question, each with the sources it cites and its editorial confidence. When the corpus cannot answer, answered is false and abstention_reason plus missing_topics say what was not covered — a refusal is a real result here, not an error. Use this when the user asked a question in words; use search when you want to see the candidates yourself.
Inputs: question (required). Returns: claims, entity, margin, answered, +9 more
compareCompare Agent Reliability objects side by sideARead-onlyIdempotentInspect
Two to six knowledge objects side by side: their cards, every indexed attribute as a matrix (the same fields api/index.json publishes, null where an object does not say), the tags they share, the relations that run between them, the neighbours they have in common, and each one's claims with sources and confidence. Use this when the question is 'X vs Y', 'is X the same as Y' or 'how does X differ from Y' — search or get_topic first if you only have names, then pass the ids. An unknown id lands in missing with a near-miss suggestion and the rest are still compared.
Inputs: ids (required). Returns: found, claims, facets, missing, +5 more
get_entityGet one Agent Reliability knowledge objectARead-onlyIdempotentInspect
Fetch one knowledge object by id, with its claims and the sources each claim cites. Use this once search, answer or get_topic has given you an id. An unknown id is not a dead end: the answer names near-miss ids you can retry with.
Inputs: id (required). Returns: found, entity, recovery
get_latestLatest verified Agent Reliability objectsARead-onlyIdempotentInspect
Most recently verified knowledge objects (freshness signal). Use this to judge how current the corpus is, or to see what changed since you last read it. It ranks by verification date and ignores your topic entirely — use search or get_topic when you want objects that are relevant rather than recent.
Inputs: limit. Returns: total, results
get_overviewOverview of Agent ReliabilityARead-onlyIdempotentInspect
Corpus overview: what this instance knows, counts by type, published tags, freshness. Use this first when you land here and do not yet know whether this corpus can answer your question.
Inputs: no named parameters. Returns: tags, by_type, instance, description, +4 more
get_sourcesSources behind Agent ReliabilityARead-onlyIdempotentInspect
The instance's source registry — each entry with its evidence tier, reliability and access date. PAGED: 25 entries by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue; its absence means you have the last page. Filter by object_id, tier, host or accessed_since to avoid paging through a registry you do not need. Use this when you need the registry entry behind a citation, or a sample of the whole registry to judge the corpus before trusting it; get_entity already tells you which sources a claim cites.
Inputs: host, tier, limit, cursor, +2 more. Returns: found, total, sources, recovery, +2 more
get_topicBrowse Agent Reliability by topicARead-onlyIdempotentInspect
List the knowledge objects carrying a tag (topics are content-backed tags). PAGED: 25 objects by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue, and its absence means you have the last page. Use this to browse a known topic; use search when you have a question rather than a tag, and get_overview to see which tags exist. An unknown tag comes back with the topics that do exist, so a miss still moves you forward.
Inputs: tag (required), limit, cursor. Returns: tag, total, results, recovery, +2 more
searchSearch Agent ReliabilityARead-onlyIdempotentInspect
Full-text search over the knowledge graph. Matching ignores accents and apostrophes, so query in the user's own words; every hit carries the fields it matched and a score. BM25 relevance: each query term is weighted by how RARE it is in this corpus and by where it hits (name 3, tags 2, questions 2, body 1). A hit must also cover a minimum share of the question's information, measured in the same rarity weights — matching only common words does not qualify. Centrality (how many objects point at this one) breaks TIES ONLY and is never part of the score, so it cannot make an irrelevant object rank. Two hits with the same matched_fields can still differ: the score is rarity-weighted, so matching a rare term is worth more than matching a common one. Use this whenever you have a question rather than an id, then follow up with get_entity.
Inputs: query (required), limit. Returns: total, results
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Decision-assurance for AI agents: an auditable action boundary + receipt before it acts.
Machine-verifiable authorization checks for autonomous AI agents.
Psyche audits for AI agents: declared vs self-reported vs revealed objectives, diffed and flagged.
MERCATOR Verify: evidence-backed verification and decision support for autonomous agents.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceAn observable autonomy harness for AI coding agents that enables long task execution without drift or cheating, while recording all actions for cost and quality steering.MIT
- AlicenseNot gradedqualityAmaintenanceLocal security layer for AI coding agents: MCP policy proxy, kernel sandbox, tamper-evident audit logMIT
- AlicenseAqualityBmaintenanceMechanical write gates, evidence receipts, and adversarial review for AI coding agents. Fable Mode enforces a Think → Prove → Attack → Write workflow before an agent earns permission to edit a workspace.1436 PyPI26MIT
- AlicenseNot gradedqualityDmaintenanceVerifiable action receipts for AI agents — agents sign claims locally, an independent witness countersigns and timestamps, anyone can verify offline.17 npmMIT
Glama MCP Gateway
Add one secure layer between your agents and this server.