Skip to main content
Glama

Generate llms.txt

generate_llms_txt
Read-onlyIdempotent

Generate a production-ready llms.txt file for any URL so AI crawlers (ChatGPT, Claude, Perplexity) can index the site cleanly. Fetches the page, extracts title/description/key links, and emits the standard llms.txt markdown format. Output is a single text blob ready to drop at site-root/llms.txt. Useful for: getting a client's site indexed by AI, drafting llms.txt for your own project, or auditing how an AI crawler would see a competitor.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesFull URL of the site to summarize, e.g. "https://example.com" or a specific landing page.
max_linksNoMaximum number of link entries to include (default 25, max 50).

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations declare readOnlyHint, idempotentHint, and destructiveHint false. The description adds that the tool fetches the page, extracts content, and emits markdown, providing useful behavioral context. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loaded with the main action and output, then providing usage scenarios. No unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (2 parameters, no output schema, comprehensive annotations), the description covers the purpose, output format, and usage scenarios. Lacks only minor details like error handling or exact llms.txt format nuances.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, and the description adds marginal value beyond schema by mentioning that the URL is fetched and summarized. Baseline 3 is appropriate as schema already documents parameters adequately.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool generates a production-ready llms.txt file for any URL, specifying the action, resource, and intended use for AI crawlers. It distinguishes itself from sibling tools by naming specific crawlers and the output format.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit usage scenarios (client sites, own projects, auditing competitors) but does not explicitly state when not to use it or alternative sibling tools for other AI visibility tasks.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

TDQS

A4.1/5.0
Disambiguation3/5

Several overlapping clusters exist: ask_pipeworx/ask_pipeworx_beta/ask_pipeworx_grounded/deep_research all handle research questions, polymarket_edges and polymarket_arbitrage both scan for trading opportunities, and discover_tools/suggest_questions serve similar discovery purposes. The long, use-case-specific descriptions help, but an agent could still easily pick the wrong tool among these near-duplicates.

Naming Consistency4/5

Most tools follow a snake_case verb_noun or noun pattern (resolve_entity, validate_claim, list_subscriptions, h1b_salary), which is fairly consistent. However, there are deviations: bare verbs like recall/remember/forget/subscribe, noun-only phrases like entity_profile and recent_changes, and the ask_pipeworx_beta suffix variant break the pattern slightly.

Tool Count2/5

34 tools is well past the 25+ threshold, and the server is named 'H1b' while only 3 of the 34 tools relate to H-1B data. The rest is a sprawling mix of data research, prediction-market analytics, memory, subscriptions, AI visibility checks, and unrelated utilities like generate_llms_txt and scan_dependency — a severe scope mismatch.

Completeness4/5

As a de facto Pipeworx research platform, the surface is nearly complete: open-ended queries, grounded evidence mode, deep multi-source research, entity resolution, comparison, claim validation, subscriptions, memory, and feedback. The H-1B sub-domain covers employer, salary, and top-sponsor lookups, though the mention of green cards is a small mismatch since only LCA data is provided.