Skip to main content
Glama

datasets_llms_facets

Read-only

Return facet counts over the AI-readiness dataset: adoption by producer, generator, TLD or category, and which AI crawlers robots.txt blocks.

Input Schema

NameRequiredDescriptionDefault
qNoOptional substring match on the site domain, max 256 characters.
botNoOptional AI crawler named inside a valid /llms.txt, e.g. GPTBot, ClaudeBot. See facet=bot for the values.
tldNoOptional exact top-level-domain filter, e.g. com, org, io.
pageNoResult page number, 1-based, default 1; page times page_size must not exceed 10000.
sortNoOptional sort order. Allowed values: relevance, rank_asc, links_desc, bytes_desc, domain_asc, crawled_desc. Defaults to relevance with q or text, otherwise rank_asc.
textNoOptional full-text match on the llms.txt title and summary, max 256 characters.
facetYesRequired facet to aggregate. Allowed values: state, source_kind, generator, bot, policy, tld, category, robots_state, robots_default, blocked_crawler, partial_crawler, content_signal_train, full_state, home_status.
stateNoOptional /llms.txt state. Allowed values: present, absent, blocked, error, skipped. blocked and error mean unknown, not absent.
validNoOptional filter; true keeps only sites serving a valid /llms.txt, false keeps the rest.
run_idNoOptional scan run id; defaults to the latest run.
categoryNoOptional exact category label carried by the source list. The top-1M run has none, so this is empty for it.
generatorNoOptional generator detected in a valid /llms.txt. Allowed values: yoast, aioseo, rankmath, wix, shopify, parked.
injectionNoOptional filter for a valid /llms.txt containing instruction-override text aimed at AI readers.
min_linksNoOptional minimum number of links in a valid /llms.txt, 0 or greater.
page_sizeNoPage size, default 20, max 100; page times page_size must not exceed 10000.
reachableNoOptional filter; true keeps only sites whose homepage control request answered, false only sites that did not.
blocks_allNoRepeatable AI crawler that robots.txt must block (AND). Allowed values: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, anthropic-ai, Google-Extended, PerplexityBot, Perplexity-User, CCBot, Bytespider, Applebot-Extended, Amazonbot, meta-externalagent, cohere-ai, Diffbot.
blocks_anyNoRepeatable AI crawler; robots.txt must block at least one (OR). Same allowed values as blocks_all.
full_validNoOptional filter; true keeps only sites serving a valid /llms-full.txt.
not_blockedNoRepeatable AI crawler that robots.txt must NOT block. Same allowed values as blocks_all.
placeholderNoOptional filter for a valid /llms.txt that still holds template placeholder text.
source_kindNoOptional producer of a valid /llms.txt. Allowed values: shopify_agent_template, seo_plugin, platform_default, parked, custom.
home_blockedNoOptional filter for sites whose homepage was walled off from the scan (a block or challenge).
mentions_mcpNoOptional filter for a valid /llms.txt that mentions the Model Context Protocol.
robots_stateNoOptional /robots.txt state. Allowed values: present, absent, blocked, error, skipped.
all_ai_blockedNoOptional filter; true keeps only sites whose robots.txt blocks all 17 tracked AI crawlers.
robots_defaultNoOptional default stance of robots.txt toward AI crawlers. Allowed values: allowed, partial, blocked.
mentions_openapiNoOptional filter for a valid /llms.txt that mentions OpenAPI or Swagger.
is_infrastructureNoOptional filter; false (the common case) excludes backend CDN/DNS/cloud-vendor hostnames that rank highly but serve no public homepage; true keeps only those.
min_train_blockedNoOptional minimum number of AI training crawlers (of 11 tracked) that robots.txt blocks, 0 or greater.
content_signal_trainNoOptional Content-Signal ai-train value declared in robots.txt. Allowed values: yes, no.

Output Schema

NameRequiredDescriptionDefault
dataYesThe tool result payload (shape varies per tool; see each tool's docs resource).

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / category / description
      Previous value: -"Optional exact category filter from the source ranking list."New value: +"Optional exact category label carried by the source list. The top-1M run has none, so this is empty for it."
  2. Added

TDQS

B3.2/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, so the safe-read profile is covered. The description adds the scope of the dataset (AI-readiness / llms.txt / robots.txt) but says nothing about pagination, defaults, or the meaning of facet values.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single dense sentence that front-loads the core action and scoping. It is efficient with no filler, though it packs several facet examples without organizing them.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 31-parameter tool with a required facet argument and a rich output schema, the description is adequate but thin: it does not mention the required facet, the allowed facet values, or how filters combine, leaving the schema to carry the load.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so all 31 parameters are documented in the schema itself. The description only restates the facet dimensions already implied by the schema and adds no syntax, format, or interaction detail beyond it.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb ('Return facet counts') and resource ('AI-readiness dataset') and enumerates the aggregation dimensions (producer, generator, TLD, category, blocked crawlers). It is clearly a facet/aggregation tool, though it never names or distinguishes itself from the sibling datasets_llms_search or datasets_llms_item.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives no when-to-use guidance and does not point to alternatives such as datasets_llms_search for row-level results. The reader must infer that this is for aggregate counts rather than record retrieval.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.