Skip to main content
Glama

Ask Pipeworx — Grounded

ask_pipeworx_grounded
Read-onlyIdempotent

Hallucination-resistant answer mode for high-stakes reads. Same routing as ask_pipeworx — picks the right tool from 5,798 across 1517 sources, fills arguments, fetches the data — then EXTRACTS the answer using ONLY what the tool result contains. Returns {answer, evidence (verbatim quote), confidence, source, fetched_at, refusal_reason:null} on success, OR an explicit refusal {answer:null, refusal_reason:"not_in_source"|"no_tool_match"|"tool_error"|"data_truncated"|"llm_error"} when the data doesn't directly answer. Use whenever an answer will be quoted, cited, or acted on, and the agent must not invent facts (financial verdicts, legal claims, medical lookups, public statements). Costs one extra LLM call vs ask_pipeworx — prefer ask_pipeworx for casual lookups.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
qNoAlias for question.
textNoAlias for question.
inputNoAlias for question.
queryNoAlias for question.
promptNoAlias for question.
questionYesYour question in natural language. Accepts query, q, prompt, text, input as aliases.

Schema Changelog

Changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. Added

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the readOnly/openWorld/idempotent annotations, the description discloses the full behavioral contract: on success it returns {answer, evidence (verbatim quote), confidence, source, fetched_at, refusal_reason:null}, and on insufficient data it returns a structured refusal with enumerated refusal_reason values. It also reveals the internal mechanism ('fills arguments, fetches the data') and the extra LLM call cost.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the defining characteristic, followed by mechanism, return shape, usage guidance, and cost tradeoff. Every sentence adds distinct value; the length is justified by the richness of the tool contract and there is no repetition or filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Even without an output schema, the description enumerates the exact success and refusal response structures, covers all likely failure modes (not_in_source, no_tool_match, tool_error, data_truncated, llm_error), and gives routing guidance vs ask_pipeworx. This is complete enough for an agent to invoke and interpret the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds context beyond the schema by explaining that the tool internally picks the right tool and fills arguments, which tells the caller that the single question parameter is all they need to provide. This is a useful semantic clarification even though the schema already describes the aliases.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb+resource: 'Hallucination-resistant answer mode for high-stakes reads.' It then explicitly contrasts with ask_pipeworx ('Same routing as ask_pipeworx' but 'EXTRACTS the answer using ONLY what the tool result contains'), cleanly distinguishing it from the sibling tool. This is the clearest possible answer to what the tool does and how it differs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description states exactly when to use it: 'Use whenever an answer will be quoted, cited, or acted on, and the agent must not invent facts,' and gives concrete high-stakes examples. It also provides the alternative condition: 'prefer ask_pipeworx for casual lookups,' naming the sibling and the cost tradeoff.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A3.5/5.0
Disambiguation2/5

The tool set includes both OpenReview-specific tools (e.g., get_paper, list_submissions) and a large number of unrelated tools for Pipeworx, Polymarket, and SEC filings. While individual descriptions are clear, the mix of domains creates confusion about which tools to use for a given task, leading to potential misselection.

Naming Consistency2/5

Tool names follow inconsistent patterns: some use underscore_case (ai_visibility_check, generate_llms_txt), some are verb_noun (get_paper, list_venues), and others use descriptive phrases (ask_pipeworx_grounded, polymarket_arbitrage). The lack of a unified naming scheme makes the tool set feel disjointed.

Tool Count2/5

With 37 tools, the count is too high for a server supposedly focused on OpenReview. Only about 6 tools are directly related to OpenReview; the rest are for unrelated domains like prediction markets, data retrieval, and memory management. The scope is unclear and overloaded.

Completeness2/5

For the OpenReview domain, the tool set covers basic retrieval (get_paper, search_notes, list_submissions) but lacks operations like creating or updating notes, which are common in a review platform. The inclusion of many non-OpenReview tools does not compensate for these gaps, leaving the surface incomplete for its stated purpose.