Skip to main content
Glama

Server Details

MCP for CourtListener: US federal and state opinions, dockets, judges, plus eCFR regulations.

Status
Healthy
Last Tested
Transport
Streamable HTTP
URL
Repository
Vaquill-AI/courtlistener-mcp
GitHub Stars
0

Glama MCP Gateway

Connect through Glama MCP Gateway for full control over tool access and complete visibility into every call.

MCP client
Glama
MCP server

Full call logging

Every tool call is logged with complete inputs and outputs, so you can debug issues and audit what your agents are doing.

Tool access control

Enable or disable individual tools per connector, so you decide what your agents can and cannot do.

Managed credentials

Glama handles OAuth flows, token storage, and automatic rotation, so credentials never expire on your clients.

Usage analytics

See which tools your agents call, how often, and when, so you can understand usage patterns and catch anomalies.

100% free. Your data is private.
Tool DescriptionsB

Average 3.7/5 across 34 of 34 tools scored. Lowest: 3/5.

Server CoherenceA
Disambiguation5/5

Tools are clearly grouped into distinct domains: citation processing, eCFR regulations, and CourtListener core entities. Within each group, each tool has a unique purpose (e.g., citation_lookup vs. citation_extract vs. citation_verify) with no ambiguity.

Naming Consistency5/5

All tool names use consistent snake_case with a clear verb_noun or noun_verb pattern (e.g., citation_lookup_citation, ecfr_get_ancestry, get_cluster, search_opinions). No mixing of conventions.

Tool Count4/5

34 tools is on the higher side but appropriate for a comprehensive legal research tool covering citations, federal regulations, and case law. Each tool serves a distinct, justified purpose without excessive overlap.

Completeness4/5

The tool set covers core workflows: citation parsing/lookup, eCFR search/structure/versions, and CourtListener entity retrieval and search. Minor gaps exist (no direct listing of all courts or batch opinion retrieval) but are compensated by search capabilities.

Available Tools

34 tools
citation_batch_lookup_citationsA
Read-only
Inspect

Look up multiple legal citations in a single request.

This is more efficient than making individual requests for each citation. Accepts up to 100 citations at once.

ParametersJSON Schema
NameRequiredDescriptionDefault
citationsYesList of citations to look up (max 100)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint and openWorldHint. The description adds the 100-citation limit but does not provide significant behavioral context beyond that.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three concise sentences with clear front-loading of the main purpose. No extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simple single-parameter schema and existing output schema, the description is fairly complete. It could mention return format but that is covered by output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%; the description repeats the max 100 citations from the schema. No additional semantic value beyond what the schema provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: looking up multiple legal citations in a single request. It distinguishes itself from sibling tools like citation_lookup_citation by emphasizing efficiency and batch processing.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear guidance on when to use this tool (for multiple citations, more efficient) but does not explicitly state when not to use it or mention alternatives.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

citation_enhanced_citation_lookupA
Read-only
Inspect

Enhanced citation lookup combining citeurl parsing with CourtListener data.

This tool first uses citeurl to parse and validate the citation format, then optionally queries the CourtListener API for additional case information.

ParametersJSON Schema
NameRequiredDescriptionDefault
citationYesThe citation to look up and analyze
include_courtlistenerNoWhether to also perform CourtListener API lookup

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds value by detailing the exact steps (parsing then optional API query), which is beyond the annotations and clearly explains the tool's behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: first states the purpose, second explains the process. It is front-loaded, concise, and contains no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (two-step process, optional parameter), high schema coverage, presence of output schema, and annotations, the description is complete. It covers the process and optionality without missing critical information.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for both parameters. The description mentions parsing and optional CourtListener lookup, which aligns with the parameters but does not add new meaning beyond what the schema provides. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it combines citeurl parsing with CourtListener data, and the process is explained. It distinguishes from siblings like citation_lookup_citation and citation_parse_citation_with_citeurl by being a two-step enhanced lookup.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage context by explaining the two-step process: first parse, then optionally query CourtListener. It doesn't explicitly name alternatives or when to avoid, but the process description provides clear guidance on when to use this tool versus singular ones.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

citation_extract_citations_from_textA
Read-only
Inspect

Extract all legal citations from a block of text using citeurl.

This tool finds and parses all legal citations within a given text, including both long-form and short-form citations (like 'id.' references).

ParametersJSON Schema
NameRequiredDescriptionDefault
textYesText containing legal citations to extract

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true, so the safe read behavior is covered. The description adds behavioral context by mentioning the use of citeurl and explicit handling of short-form citations like 'id.', which goes beyond the annotation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences: the first immediately states the core purpose, and the second adds relevant detail about citation types. Every word earns its place; there is no fluff or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With one well-described parameter, safety annotations, and an existing output schema, the description is nearly complete. It could mention typical usage or edge cases (e.g., handling of malformed text), but the current information is sufficient for an extraction tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The only parameter 'text' is fully described in the input schema (description: 'Text containing legal citations to extract'), achieving 100% schema coverage. The description adds no additional meaning beyond the schema's own description.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it extracts all legal citations from a block of text using citeurl, specifying both long-form and short-form citations. This differentiated it from sibling tools like citation_lookup_citation (which looks up a single citation) and citation_parse_citation_with_citeurl (which parses a citation) by focusing on extraction from raw text.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when text contains legal citations but does not explicitly state when to use this tool versus alternatives like citation_batch_lookup_citations or citation_verify_citation_format. No when-not-to-use or alternative recommendations are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

citation_lookup_citationA
Read-only
Inspect

Look up a legal citation to find the opinion it references in CourtListener.

This tool accepts various citation formats including:

  • U.S. Reporter citations (e.g., "410 U.S. 113")

  • Federal Reporter citations (e.g., "123 F.3d 456")

  • WestLaw citations (e.g., "2023 WL 12345")

  • State reporter citations

ParametersJSON Schema
NameRequiredDescriptionDefault
citationYesThe citation to look up (e.g., '410 U.S. 113', '2023 WL 12345')

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds no behavioral details beyond what annotations provide, such as what happens on invalid citations or rate limits. No contradiction.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is very concise: two short paragraphs, with the first sentence directly stating the purpose and the second listing examples. Every sentence adds value with no fluff.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple lookup tool with one parameter and an existing output schema, the description adequately covers purpose and accepted formats. It does not mention error handling or performance, but given the tool's simplicity and the presence of an output schema, it is sufficiently complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with a clear description of the citation parameter. The description adds valuable context by listing example formats (U.S. Reporter, Federal Reporter, WestLaw, state), which helps the agent understand accepted input formats beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'look up' and the resource 'legal citation to find the opinion it references'. It distinguishes from siblings like citation_batch_lookup_citations (batch) and citation_enhanced_citation_lookup (enhanced), so the agent knows to use this for single citation lookup.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides context by listing accepted citation formats, but does not explicitly state when to use this tool versus siblings (e.g., batch or enhanced lookup). Implied usage for single citations, but no exclusion guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

citation_parse_citation_with_citeurlA
Read-only
Inspect

Parse a legal citation using citeurl's advanced citation recognition.

This tool uses the citeurl library to parse legal citations and extract structured information including tokens, normalized format, and URL generation.

Returns detailed information about the citation including:

  • Recognized citation format and source

  • Extracted tokens (volume, reporter, page, etc.)

  • Generated URL if available

  • Normalized citation text

ParametersJSON Schema
NameRequiredDescriptionDefault
broadNoUse broad matching for more flexible parsing
citationYesThe citation to parse (e.g., '410 U.S. 113', '42 USC § 1988')

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, so the description's behavioral disclosure of returning 'tokens, normalized format, and URL generation' adds useful context about the output richness. It does not contradict annotations. However, it does not describe error handling or rate limits, but the additional detail on returned data is valuable.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with three focused sentences. The first sentence immediately states the core purpose, and subsequent sentences detail the output without redundancy. Every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the presence of an output schema and simple parameters, the description covers the tool's purpose and key results (tokens, URL, normalized text). It does not address failure scenarios or interpretation of results, but overall it is sufficiently complete for an agent to understand what the tool returns.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description does not add further meaning to the 'broad' parameter beyond what the schema provides. It describes output fields but not parameter behavior.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function: parsing a legal citation using the citeurl library. It specifies the verb 'Parse', the resource 'legal citation', and highlights advanced recognition. It distinguishes from sibling tools like citation_lookup_citation by emphasizing structured output including tokens and URL generation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for extracting detailed citation information but does not provide explicit guidance on when to use this tool over alternatives like citation_lookup_citation or citation_extract_citations_from_text. No when-not-to-use or context exclusions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

citation_verify_citation_formatA
Read-only
Inspect

Verify if a citation string is in a valid format using citeurl's advanced parsing.

This tool performs validation using citeurl's comprehensive citation templates to check if a citation appears to be in a recognized legal citation format. This is much more accurate than simple regex matching.

Returns information about the citation format and any detected issues.

ParametersJSON Schema
NameRequiredDescriptionDefault
citationYesThe citation to verify

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations set readOnlyHint=true (safe read). Description adds that it uses citeurl's comprehensive templates and returns info about format and issues, providing behavioral context beyond annotations. Could note potential failure scenarios.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three short sentences, each adding value: purpose, method, output. No redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool is simple (one param), has output schema, and description covers purpose, process, and return type. Complete for the tool's complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a single 'citation' parameter described as 'The citation to verify'. Description does not add significant new semantics beyond the schema, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'verify', the resource 'citation string', and the method 'using citeurl's advanced parsing'. It distinguishes from siblings like citation_parse_citation_with_citeurl (which parses) and citation_lookup_citation (which looks up).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies it's for verifying format validity and claims higher accuracy than regex, but does not explicitly state when to use versus siblings, nor does it provide exclusions or prerequisites.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_ancestryA
Read-only
Inspect

Get the ancestry chain (title -> ... -> node) for a CFR node on a date.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateYesSnapshot date (YYYY-MM-DD)
partNoRestrict to a part, e.g. '75'
titleYesCFR title number (1-50)
sectionNoRestrict to a section, e.g. '75.1'

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint, so the description adds little beyond specifying date-sensitivity. No contradictions, but no added context about rate limits or result stability.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence conveys the core purpose without extraneous words or repetition.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return value documentation is covered. The description is adequate for a simple lookup tool, though the term 'ancestry chain' could be slightly expanded for clarity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the description does not need to add parameter details. The 'on a date' phrasing echoes the date parameter but adds no new meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool retrieves the ancestry chain of a CFR node given a title and date, distinguishing it from sibling tools like ecfr_get_title_structure or ecfr_search_regulations.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives, nor any conditions or prerequisites mentioned beyond the required parameters.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_daily_search_countsB
Read-only
Inspect

Get search result counts broken down by date (daily histogram).

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoAs-of date (YYYY-MM-DD)
queryYesFull-text search query over the CFR

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint=true and openWorldHint=true, so the safety profile is clear. The description adds no additional behavioral context such as response format, pagination, or error handling beyond confirming it is a read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is front-loaded with the verb and resource. Every word adds value with no redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has an output schema, so return values need not be described. However, the description lacks details like default date range or histogram granularity. With 100% schema coverage and a simple parameter set, it is minimally adequate but could be improved.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema coverage is 100% with descriptions for both parameters (date and query). The description does not add further meaning beyond the schema, but the baseline is 3 due to high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool provides search result counts broken down by date as a daily histogram. The verb 'Get' and resource 'search result counts' are specific, and it distinguishes from siblings like ecfr_get_search_count which likely returns total counts without date breakdown.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives like ecfr_get_search_count or ecfr_get_search_summary. The description only states the function without context or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_hierarchy_search_countsB
Read-only
Inspect

Get search result counts distributed across the CFR hierarchy.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoAs-of date (YYYY-MM-DD)
queryYesFull-text search query over the CFR

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds the nuance that results are 'distributed across the hierarchy,' which hints at the output structure. However, it does not elaborate on pagination, grouping, or how the hierarchy is represented beyond what the output schema might provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 8 words, achieving maximum conciseness. It front-loads the essential purpose. However, it sacrifices usage guidance and differentiation, which would improve clarity for the agent.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the presence of an output schema and comprehensive annotations, the description is minimally complete. It conveys the core function but lacks details on how the hierarchy is structured in the response, how to interpret the counts, or how it differs from similar search tools, making it only moderately complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the schema adequately documents both parameters (query, date). The description adds no extra meaning; it does not mention the date parameter or clarify how the query interacts with the hierarchy. Hence baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('get'), the resource ('search result counts'), and the scope ('distributed across the CFR hierarchy'). This verb-resource-qualifier combination distinguishes it from siblings like `ecfr_get_search_count` (total count) and `ecfr_get_title_search_counts` (per-title counts).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus its many siblings (e.g., ecfr_get_search_count, ecfr_get_search_summary). There is no mention of prerequisites, context, or exclusion criteria, leaving the agent uncertain about which tool fits a given scenario.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_search_countA
Read-only
Inspect

Get the total number of CFR sections matching a search query.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoAs-of date (YYYY-MM-DD)
queryYesFull-text search query over the CFR
titleNoRestrict to a title
agency_slugsNoRestrict to agency slugs

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds that it returns a count of sections, which is consistent but does not disclose any additional behavioral traits such as performance or pagination beyond what annotations imply.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single concise sentence that front-loads the purpose. However, it could be slightly restructured to include brief usage context while remaining succinct.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the presence of annotations, output schema, and the simplicity of a count tool, the description is sufficiently complete. It lacks explicit mention of the return format but that is covered by the output schema.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 100% schema description coverage, the baseline is 3. The description does not add extra meaning beyond the schema: it only repeats the concept of a search query without elaborating on other parameters like date, title, or agency_slugs.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'total number of CFR sections matching a search query', distinguishing it from sibling tools like ecfr_get_search_suggestions or ecfr_get_search_summary.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. The single sentence describes what it does but offers no context for decision-making among similar search tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_search_suggestionsB
Read-only
Inspect

Get search-term suggestions for a partial CFR query.

ParametersJSON Schema
NameRequiredDescriptionDefault
queryYesPartial query to get suggestions for

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds no further behavioral traits such as rate limits, result set characteristics, or autocomplete behavior. It is consistent with annotations but does not enhance transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence of 7 words, perfectly concise and front-loaded with the key action and resources. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple autocomplete tool with one parameter, annotations, and an output schema, the description provides the essential purpose. It could optionally mention return format but is adequately complete given the tool's simplicity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%; the description for 'query' in the schema is already clear. The tool description adds no additional meaning beyond the schema, so baseline score of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'search-term suggestions', and the context 'for a partial CFR query'. It precisely differentiates from sibling tools like ecfr_search_regulations and ecfr_get_search_count.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives such as ecfr_search_regulations or ecfr_get_search_count. No exclusions or context are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_search_summaryA
Read-only
Inspect

Get summary details (counts + metadata) for a CFR search query.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoAs-of date (YYYY-MM-DD)
queryYesFull-text search query over the CFR
titleNoRestrict to a title
agency_slugsNoRestrict to agency slugs

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint and openWorldHint. The description adds 'counts + metadata', which is consistent but does not provide significant additional behavioral context beyond what annotations convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with the core purpose. No extraneous information. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the 4 parameters are fully described in the schema and there is an output schema, the description adequately conveys the tool's output (summary details). Could benefit from slightly more detail on what 'metadata' includes, but overall sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description does not add any parameter-level semantics beyond the schema; it only mentions 'CFR search query' generically.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and the resource 'summary details (counts + metadata)' for a CFR search query. It distinguishes from sibling tools like ecfr_get_search_count by mentioning 'metadata' and 'summary', indicating a broader scope.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus similar siblings (e.g., ecfr_get_search_count, ecfr_get_daily_search_counts). The description only states what it does without providing usage context or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_source_xmlA
Read-only
Inspect

Fetch the source regulation TEXT (XML) for a CFR node on a snapshot date.

Pass a part or section to scope the request. Fetching an entire large title at once can time out on the eCFR side, so narrowing is strongly recommended. Returns the raw XML under content_xml.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateYesSnapshot date (YYYY-MM-DD)
partNoPart to fetch, e.g. '75'. STRONGLY recommended: whole-title fetches can time out.
titleYesCFR title number (1-50)
chapterNoChapter, e.g. 'I'
sectionNoSection, e.g. '75.1'
subpartNoSubpart, e.g. 'C'
appendixNoAppendix identifier
subtitleNoSubtitle, e.g. 'A'
subchapterNoSubchapter, e.g. 'B'

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds significant context: it fetches raw XML, returns it under content_xml, and warns about potential timeouts for large titles. No contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with three front-loaded sentences: purpose, recommendation, and return value. No redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's 9 parameters and output schema, the description covers the main behavior and timeout warning. It could be more explicit about parameter interactions (e.g., combining part and section), but schema and annotations fill many gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so baseline is 3. The description adds value by emphasizing scoping and timeout risks, which provides extra context beyond the schema's parameter descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool fetches source regulation TEXT (XML) for a CFR node on a snapshot date, using specific verbs and resources. It distinguishes from siblings like ecfr_get_title_structure or ecfr_search_regulations by focusing on raw XML content retrieval.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear advice on scoping requests (pass a part or section) and warns against fetching whole titles due to timeouts. However, it does not mention alternatives among siblings or explicitly state when not to use this tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_title_search_countsB
Read-only
Inspect

Get search result counts broken down by CFR title.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoAs-of date (YYYY-MM-DD)
queryYesFull-text search query over the CFR

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true. The description confirms the core behavior but adds no extra details about edge cases or response structure. It is consistent with annotations and provides basic transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, front-loaded sentence of about 10 words. No unnecessary information, though it could slightly expand on the output nature without losing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with 2 parameters, annotations, and an output schema, the description is mostly complete. It clearly states the purpose, and the output schema presumably handles return details. Minor lack of guidance on usage context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with descriptions for both 'date' and 'query' in the input schema. The tool description adds no additional parameter meaning beyond what the schema provides, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('get') and the resource ('search result counts broken down by CFR title'). It differentiates from siblings like 'ecfr_get_search_count' (likely total) and 'ecfr_get_hierarchy_search_counts' (maybe by hierarchy), though it doesn't explicitly exclude alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus siblings like 'ecfr_get_search_count' or 'ecfr_get_hierarchy_search_counts'. The description provides no contextual cues for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_title_structureA
Read-only
Inspect

Get the full hierarchical structure (title -> section) of a CFR title on a date.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateYesSnapshot date (YYYY-MM-DD)
titleYesCFR title number (1-50)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, so the description's disclosure of the hierarchical structure and date dependency is sufficient. It adds value by clarifying the output type (title -> section) beyond what annotations provide.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with no wasted words. It is front-loaded with the key action and resource, making it efficient and easy to parse.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that an output schema exists, the description does not need to detail return values. It covers the essential purpose and input parameters adequately. Could mention the tree nature more explicitly, but overall complete enough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, with both parameters described. The description does not add additional meaning beyond what is in the schema (e.g., date format, title range). Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb ('Get'), clearly identifies the resource ('full hierarchical structure of a CFR title'), and specifies the input constraints ('on a date'). It distinguishes this tool from siblings by focusing on structural retrieval rather than searches, corrections, or versions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. The context from sibling tool names suggests it is for structural data, but the description does not provide exclusions or comparison with other ecfr tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_get_title_versionsA
Read-only
Inspect

List the available content versions (issue dates) for one CFR title.

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesCFR title number (1-50)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds that it lists versions/issue dates, which aligns with read behavior. It does not detail pagination or ordering, but the annotations cover the safety profile, making this acceptable.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence with 10 words, conveying the action and resource efficiently. No unnecessary information is included.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the availability of an output schema, the description need not explain return values. It adequately covers the tool's purpose. While it lacks details on pagination, the simple nature of the operation and schema richness make this sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with one parameter (title) clearly described. The description does not add additional meaning beyond the schema, such as formatting or constraints, so a baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'List' and the resource 'available content versions (issue dates) for one CFR title'. It effectively distinguishes this tool from siblings like ecfr_get_title_structure (structure) and ecfr_list_titles (list titles), making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for listing versions but does not explicitly state when to use this tool versus alternatives like ecfr_get_title_structure or ecfr_list_titles. No exclusions or alternative tool references are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_list_agenciesA
Read-only
Inspect

List all agencies that appear in the CFR, with their title/chapter references.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds that the output contains title/chapter references, but does not disclose other behavioral aspects like result format or ordering. With annotations covering safety, this is adequate but not rich.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that conveys the purpose and output without unnecessary words. It is appropriately front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has no parameters and has an output schema, the description is complete enough to inform an AI agent. It specifies the main output content, though it could mention ordering or result size.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There are no parameters, so the description does not need to compensate. The schema coverage is 100%, and the description aligns with the tool's stateless behavior.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action 'list', the resource 'all agencies that appear in the CFR', and the output includes 'their title/chapter references', making it distinct from sibling tools like ecfr_list_titles.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, such as ecfr_get_title_structure or ecfr_search_regulations. There are no exclusions or context hints.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_list_all_correctionsB
Read-only
Inspect

List CFR corrections, optionally filtered by title and/or effective date.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoCorrections in effect on this date (YYYY-MM-DD)
titleNoRestrict to a CFR title number

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description adds little beyond the annotations; it confirms a read-only operation but fails to mention the openWorldHint implication or any other behavioral details.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that efficiently communicates the core functionality and optional filters.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the presence of an output schema and annotations, the description adequately covers the tool's purpose and parameters, though it could optionally mention the date format or result scope.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds no value beyond the schema's parameter descriptions, merely echoing the optional filtering.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool lists CFR corrections with optional filters, but does not differentiate from the sibling tool ecfr_list_corrections_by_title, which likely serves a similar purpose.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like ecfr_list_corrections_by_title, nor does it specify conditions for usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_list_corrections_by_titleA
Read-only
Inspect

List all corrections for a single CFR title.

ParametersJSON Schema
NameRequiredDescriptionDefault
titleYesCFR title number (1-50)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint, so the description does not need to repeat those. However, the description adds no extra behavioral context (e.g., pagination, rate limits), so it meets the baseline but adds little value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no unnecessary words. It is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one well-documented parameter, a clear output schema, and informative annotations, the description is sufficiently complete. It captures the core function without needing elaboration.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema already covers 100% of the parameter description (title number 1-50). The description does not add any additional meaning or context beyond what the schema provides, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('list') and the resource ('corrections for a single CFR title'), and the tool name distinguishes it from the sibling 'ecfr_list_all_corrections', making the purpose specific and unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies that this tool is for a specific title versus 'ecfr_list_all_corrections' for all titles, but it does not explicitly state when to use this tool over alternatives, leaving the choice inferred.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_list_titlesA
Read-only
Inspect

List all 50 CFR titles with their latest amended/issue dates and status.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds that it lists titles with dates and status, which aligns but does not significantly extend beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, no wasted words, front-loaded with purpose. Ideal conciseness for a simple tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given zero parameters, presence of output schema, and clear description of what is returned, the description is complete for a list tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist; schema coverage is 100%. Baseline is 4, and description does not need to add parameter info.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly specifies verb (List), resource (all 50 CFR titles), and included details (latest dates and status). It distinguishes from sibling tools that are more specific (e.g., ecfr_get_title_structure).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use or alternatives. Since there are no parameters, usage is straightforward, but the description lacks explicit when-to-use context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

ecfr_search_regulationsA
Read-only
Inspect

Full-text search over federal regulations, returning matching sections with hierarchy.

ParametersJSON Schema
NameRequiredDescriptionDefault
dateNoSearch the CFR as of this date (YYYY-MM-DD)
pageNoPage number
orderNoSort order: 'relevance', 'hierarchy', 'newest_first', 'oldest_first'
queryYesFull-text search query over the CFR
titleNoRestrict to a CFR title number
per_pageNoResults per page (max 20)
agency_slugsNoRestrict to one or more agency slugs (from list_agencies)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The annotations already declare readOnlyHint=true and openWorldHint=true, indicating no destructive side effects. The description adds that the tool returns 'matching sections with hierarchy,' which is a behavioral trait beyond the annotations. However, it does not disclose potential limitations (e.g., result size, rate limits) or authentication requirements.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence (12 words) that front-loads the core action and output. Every word is essential, with no redundancy. It is well-structured for quick comprehension.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool has 7 parameters and an output schema exists, the description is adequate for core purpose but lacks additional context such as pagination behavior, the meaning of 'hierarchy' in results, or the impact of the 'openWorldHint' annotation. The presence of an output schema mitigates the need to describe return values, but some operational context is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description does not add any additional meaning beyond what the parameter descriptions already provide. It does not elaborate on how parameters like 'order' or 'agency_slugs' affect results.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description 'Full-text search over federal regulations, returning matching sections with hierarchy' clearly states the verb (search), resource (federal regulations), and the output format (sections with hierarchy). It distinguishes itself from sibling tools like 'ecfr_get_search_summary' and 'ecfr_get_search_suggestions' which serve different purposes, and from other search tools for different domains (e.g., 'search_audio', 'search_dockets').

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is for searching regulations full-text, but it does not explicitly state when to use this tool versus alternatives like 'ecfr_get_search_summary' (for aggregated counts) or 'ecfr_get_search_suggestions' (for autocomplete). No guidance on exclusions or prerequisites is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_audioA
Read-only
Inspect

Get oral argument audio information by ID from CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
audio_idYesThe audio recording ID to retrieve

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, indicating a safe read operation with potentially incomplete responses. The description adds that it retrieves 'oral argument audio information', but does not elaborate on response structure or edge cases.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is clear and concise, with no unnecessary words. It is appropriately front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, the description does not need to explain return values. It sufficiently conveys the tool's purpose and matches the complexity of a single-parameter retrieval tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the parameter 'audio_id' is fully documented in the schema. The description does not add additional meaning beyond what the schema provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 'Get' and a resource 'oral argument audio information by ID', clearly distinguishing it from sibling tools like 'search_audio' and other get_* tools that retrieve different entities.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implicitly states to use this tool when you have an audio ID, but does not explicitly mention when not to use it or provide alternatives. However, the context from the tool name and sibling tools makes usage straightforward.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_clusterB
Read-only
Inspect

Get an opinion cluster by ID from CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
cluster_idYesThe opinion cluster ID to retrieve

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint and openWorldHint. The description adds no additional behavioral context (e.g., no mention of rate limits, caching, or data freshness) beyond the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, perfectly concise with no redundant information. All words add value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Tool has an output schema, so return values are documented. However, the description is minimal and does not explain what an 'opinion cluster' is, which may be needed for context. Adequate but barely.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers 100% parameter description; the description adds no extra semantic value beyond 'get by ID'. Baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get'), the resource ('opinion cluster'), and the identifier method ('by ID') and source ('CourtListener'). It uniquely identifies the tool among siblings like get_docket or get_opinion.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives like search_opinions, or prerequisites. Only states basic retrieval; lacks any conditional or exclusionary advice.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_courtA
Read-only
Inspect

Get court information by ID from CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
court_idYesThe court ID to retrieve (e.g., 'scotus', 'ca9')

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the safety profile is clear. The description adds no additional behavioral context (e.g., authentication needs, rate limits, or side effects). It neither contradicts nor enriches the annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single front-loaded sentence with no superfluous words. It communicates the core purpose efficiently.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that the tool has an output schema (as indicated by context signals) and a single well-documented parameter, the description is sufficiently complete. It identifies the entity and action without needing to detail return format.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a clear description for court_id. The tool description adds no extra meaning beyond the schema's explanation. Baseline 3 is appropriate since the schema handles parameter semantics adequately.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'court information', and the source 'by ID from CourtListener'. It is specific and distinguishes from sibling tools that retrieve other entities (e.g., get_audio, get_cluster).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description does not provide explicit guidance on when to use this tool versus alternatives. Context from sibling tool names implies differentiation by entity type, but no direct exclusions or prerequisites are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_docketA
Read-only
Inspect

Get a specific court docket by ID from CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
docket_idYesThe docket ID to retrieve

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description simply says 'Get' which aligns but adds no extra behavioral traits such as authentication needs, rate limits, or error behavior. It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, front-loaded with the action and resource, and contains no unnecessary words. It earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is simple (one parameter, read-only, has output schema). The description covers the core functionality. While it doesn't mention edge cases like missing ID, the annotations and output schema provide sufficient context for an agent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% for the single parameter docket_id, with the schema providing a clear description. The description does not add any additional meaning beyond what the schema already offers.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get', the resource 'specific court docket', and the method 'by ID from CourtListener'. This is specific and distinguishes it from sibling tools like search_dockets (which search) and other get tools (which get different entities).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you have a docket ID, but it does not explicitly state when to use this tool versus alternatives like search_dockets or other get tools. No exclusions or context are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_opinionA
Read-only
Inspect

Get a specific court opinion by ID from CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
opinion_idYesThe opinion ID to retrieve

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint, so the description's burden is lighter. The description adds no further behavioral context beyond 'by ID'. No contradictions with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no redundancy, fitting the tool's simplicity. It is front-loaded and efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one parameter, output schema present), the description is largely complete. It identifies the source (CourtListener) and operation, but could marginally benefit from mentioning that the opinion ID is required.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% for the single parameter 'opinion_id'. The description does not add new semantics beyond the schema's description. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly specifies the verb 'Get', the resource 'court opinion', the method 'by ID', and the source 'from CourtListener'. It distinguishes this tool from sibling 'get_' tools like 'get_audio', 'get_cluster', etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when you have a specific opinion ID, but it does not provide explicit guidance on when to use this tool versus alternatives like 'search_opinions'. No when-not or conditions are mentioned.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_personA
Read-only
Inspect

Get judge or legal professional information by ID from CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
person_idYesThe person (judge) ID to retrieve

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint, so the description's additional context ('by ID from CourtListener') adds minimal value. The description does not contradict annotations, but it doesn't disclose any behavioral traits beyond what annotations already convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, directly front-loaded sentence with no unnecessary words. It is appropriately sized and every word adds value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (single parameter, high schema coverage, and an output schema), the description sufficiently covers the core purpose. It does not need to explain return values due to the existing output schema. Minor gap: no mention of what constitutes a valid ID or error handling, but this is acceptable for a straightforward retrieval tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100% with a clear definition for person_id. The description does not add any extra meaning or usage context for the parameter beyond what the schema already provides, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Get') and the resource ('judge or legal professional information'), which effectively distinguishes it from sibling tools like search_people that focus on searching rather than retrieval by ID.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when a person ID is available, but it lacks explicit guidance on when not to use this tool or how it compares to alternatives like search_people. No when-to-use or when-not-to-use conditions are provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_audioB
Read-only
Inspect

Search oral argument audio recordings in CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query for oral argument audio
courtNoCourt ID filter (e.g., 'scotus', 'ca9')
judgeNoFilter by judge name
limitNoMax results from this page (upper bound; CL pages ~20)
cursorNoPagination cursor from a prior response's next_cursor
order_byNoSort by 'score desc', 'dateArgued desc', or 'dateArgued asc'score desc
case_nameNoFilter by case name
argued_afterNoFilter arguments after this date (YYYY-MM-DD)
argued_beforeNoFilter arguments before this date (YYYY-MM-DD)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, indicating a safe read operation with variable results. The description adds no additional behavioral context beyond what annotations provide, such as data source specifics or performance characteristics.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no wasted words. However, given the tool's complexity (9 parameters, output schema), it could benefit from slightly more structure or context without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

While the output schema exists and partially compensates, the description lacks crucial context like the scope of search (only metadata), data source specifics, or the fact that it oral argument audio from U.S. courts. It feels incomplete for a tool with many parameters.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% parameter description coverage, so the schema already documents each parameter thoroughly. The description adds no extra meaning beyond the schema, meeting the baseline but not exceeding it.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'oral argument audio recordings in CourtListener', leaving no ambiguity. It is distinct from siblings like search_opinions or search_dockets due to the specific focus on audio recordings.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives. It does not mention prerequisites, exclusions, or context for selection among sibling search tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_docketsA
Read-only
Inspect

Search federal cases (dockets) from PACER in CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query for docket text
courtNoCourt ID filter (e.g., 'scotus', 'ca9')
limitNoMax results from this page (upper bound; CL pages ~20)
cursorNoPagination cursor from a prior response's next_cursor
order_byNoSort by 'score desc', 'dateFiled desc', or 'dateFiled asc'score desc
case_nameNoFilter by case name
party_nameNoFilter by party name
docket_numberNoSpecific docket number to search for
date_filed_afterNoFilter dockets filed after this date (YYYY-MM-DD)
date_filed_beforeNoFilter dockets filed before this date (YYYY-MM-DD)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. Description adds only source context, no additional behavioral traits like pagination behavior or performance characteristics.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words, front-loaded with key information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Output schema exists, so return values are covered. Parameters are well-documented in schema; missing only minor context like pagination behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so description adds no new meaning beyond what parameters already provide.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description specifies verb 'Search', resource 'federal cases (dockets)', and source 'PACER in CourtListener', clearly differentiating from sibling tools like search_opinions and search_people.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives such as search_dockets_with_documents or other search tools; lacks when-not or context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_dockets_with_documentsA
Read-only
Inspect

Search federal cases (dockets) with up to three nested documents.

If there are more than three matching documents, the more_docs field will be true.

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query for federal cases
courtNoCourt ID filter (e.g., 'scotus', 'ca9')
limitNoMax results from this page (upper bound; CL pages ~20)
cursorNoPagination cursor from a prior response's next_cursor
order_byNoSort by 'score desc', 'dateFiled desc', or 'dateFiled asc'score desc
case_nameNoFilter by case name
party_nameNoFilter by party name
docket_numberNoSpecific docket number to search for
date_filed_afterNoFilter dockets filed after this date (YYYY-MM-DD)
date_filed_beforeNoFilter dockets filed before this date (YYYY-MM-DD)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, covering safety and data completeness. Description adds valuable behavioral detail: 'up to three nested documents' and 'more_docs field will be true' for excess documents, which enriches transparency beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise, front-loaded sentences with no wasted words. Every sentence adds value: first explains core purpose, second explains the nested document limit behavior.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (10 params, output schema, annotations), the description fully explains the key behavioral quirk (nested doc limit) and overall purpose. No obvious gaps remain for an AI agent to understand selection and invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema has 100% coverage with descriptions for all parameters. Description adds no extra parameter-level meaning, so baseline 3 is appropriate; it explains the tool's behavior but not parameter specifics beyond schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description states 'Search federal cases (dockets) with up to three nested documents.' Clearly identifies the action (search) and resource (dockets with nested documents), distinguishing it from sibling 'search_dockets' which lacks nested document capability.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description implies usage for cases needing nested documents but does not explicitly say when to use this versus alternatives like 'search_dockets' or 'search_opinions'. No exclusions or when-not-to-use guidance, only implied context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_opinionsB
Read-only
Inspect

Search case law opinion clusters with nested Opinion documents in CourtListener.

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query for full text of opinions
courtNoCourt ID filter (e.g., 'scotus', 'ca9')
judgeNoFilter by judge name
limitNoMax results from this page (upper bound; CL pages ~20)
cursorNoPagination cursor from a prior response's next_cursor
cited_gtNoMinimum number of times opinion has been cited
cited_ltNoMaximum number of times opinion has been cited
order_byNoSort by 'score desc', 'dateFiled desc', or 'dateFiled asc'score desc
case_nameNoFilter by case name
filed_afterNoOnly show opinions filed after this date (YYYY-MM-DD)
filed_beforeNoOnly show opinions filed before this date (YYYY-MM-DD)

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true. The description adds 'with nested Opinion documents' but does not elaborate on pagination, rate limits, or the implications of open world (e.g., incomplete result sets). It does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single short sentence, efficient and front-loaded. However, it is perhaps too sparse for a tool with 11 parameters, but still earns high marks for no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity (11 parameters, output schema exists, annotations), the description lacks completeness. It does not explain pagination via cursor, the structure of returned clusters, or how to interpret the open world hint. More information would help an agent use the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with each parameter having a clear description. The tool description adds no new meaning beyond what the schema already provides, so it meets the baseline.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the resource 'case law opinion clusters with nested Opinion documents'. It distinguishes from sibling tools like get_opinion, search_audio, etc., by specifying the search over opinion clusters.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No explicit guidance on when to use this tool versus alternatives. For example, it does not mention that get_opinion is for a single opinion, or that other search tools target different documents. The description provides no contextual usage advice.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_peopleA
Read-only
Inspect

Search judges and legal professionals in the CourtListener database.

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query for judges and legal professionals
nameNoFilter by person's name
limitNoMax results from this page (upper bound; CL pages ~20)
cursorNoPagination cursor from a prior response's next_cursor
schoolNoFilter by school attended
order_byNoSort by 'score desc' or 'name asc'score desc
appointed_byNoFilter by appointing authority
position_typeNoFilter by position type (e.g., 'jud' for judge)
selection_methodNoFilter by selection method
political_affiliationNoFilter by political affiliation

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already indicate readOnlyHint=true and openWorldHint=true, so the description does not need to repeat safety. However, it adds no behavioral context beyond the basic purpose, such as pagination behavior or rate limits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the core purpose with no wasted words. It is appropriately concise for a simple search tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 10 parameters and an output schema, the description is minimal. While the output schema covers return values, the description lacks contextual details like typical search behavior or filtering nuances. It is adequate but incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the input schema fully documents all 10 parameters. The description adds no extra meaning beyond the high-level purpose, meeting the baseline for high coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Search' and the target 'judges and legal professionals in the CourtListener database', distinguishing it from sibling tools like 'get_person' which retrieves a single person.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for searching people, but does not explicitly state when to use this tool vs alternatives or provide exclusions. The context from sibling tool names supplements, but lacks direct guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

search_recap_documentsB
Read-only
Inspect

Search federal filing documents from PACER in the RECAP archive.

ParametersJSON Schema
NameRequiredDescriptionDefault
qYesSearch query for RECAP filing documents
courtNoCourt ID filter (e.g., 'scotus', 'ca9')
limitNoMax results from this page (upper bound; CL pages ~20)
cursorNoPagination cursor from a prior response's next_cursor
order_byNoSort by 'score desc', 'dateFiled desc', or 'dateFiled asc'score desc
case_nameNoFilter by case name
party_nameNoFilter by party name
filed_afterNoFilter documents filed after this date (YYYY-MM-DD)
filed_beforeNoFilter documents filed before this date (YYYY-MM-DD)
docket_numberNoSpecific docket number to search for
document_numberNoSpecific document number to search for
attachment_numberNoSpecific attachment number to search for

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint and openWorldHint, so the description adds no extra behavioral context. It does not mention pagination, result format, or that it queries RECAP archive specifically. However, it does not contradict annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single sentence with no unnecessary words. It is front-loaded with the key information (search federal filing documents from PACER in RECAP). Efficient and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite having 12 parameters including pagination, filters, and sorting, the description is minimal. It does not mention pagination (cursor, limit), filter capabilities (court, dates, names), or sorting options. The presence of an output schema partially compensates, but the description lacks essential completeness for a complex search tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

All 12 parameters are fully described in the input schema (100% coverage). The description does not add any additional meaning or examples beyond what the schema already provides, meeting the baseline for this dimension.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states verb 'Search' and resource 'federal filing documents from PACER in the RECAP archive', which is specific and distinguishes it from sibling tools that search opinions, dockets, audio, etc.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus sibling search tools (e.g., search_opinions, search_dockets). The description does not specify conditions or alternatives, leaving the agent without context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

statusAInspect

Check the status of the CourtListener MCP server.

Returns: A dictionary containing server status, system metrics, and service information.

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

Output Schema

ParametersJSON Schema
NameRequiredDescription

No output parameters

Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses the return content (status, system metrics, service information), which adds value beyond the empty schema, but lacks information on side effects, authentication needs, or rate limits. With no annotations, the description carries a higher burden.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences without unnecessary words; the purpose and return are front-loaded.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no parameters and an output schema, the description sufficiently covers what the tool does, though it could mention whether authentication is required or if the call is safe to repeat.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

No parameters exist, so schema coverage is 100%. The description does not need to explain parameter semantics, and the baseline for zero parameters is 4.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's action ('Check the status') and resource ('CourtListener MCP server'), distinguishing it from sibling tools focused on search and retrieval.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies using this tool to check server health, but does not explicitly specify when to use it versus alternatives or exclude inappropriate use cases.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Discussions

No comments yet. Be the first to start the discussion!

Try in Browser

Your Connectors

Sign in to create a connector for this server.