Skip to main content
Glama

Sitemap URL extractor

sitemap_urls
Read-onlyIdempotent

List the pages of a website from its sitemaps: finds them via robots.txt or common paths, follows sitemap indexes, reads gzip, text and feed sitemaps, returns URLs with lastmod. Free: up to 2,000 URLs from 12 sitemap files. With bulk=true: up to 5,000 URLs from 20 files for $0.004 USDC. Paid calls made without a payment return isError with the x402 v2 PaymentRequired object (amount in USDC atomic units, network, payTo, HTTP endpoint); retry with the signed PaymentPayload in params._meta["x402/payment"]. Invalid input and calls where every item fails are never charged. Fetches follow robots.txt, use the User-Agent AdamHaleTools/1.0 and refuse private or internal addresses.

Input Schema

NameRequiredDescriptionDefault
urlYesA domain (sitemaps are discovered) or the URL of one sitemap file, e.g. "github.blog".
bulkNotrue = paid tier (5,000 URLs, 20 files).
x402_paymentNoOptional, paid tier only: a signed x402 v2 PaymentPayload, base64 (the value an HTTP client sends as the PAYMENT-SIGNATURE header). Prefer params._meta["x402/payment"]. Never a private key or seed phrase.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Goes far beyond annotations: details free tier limits (2,000 URLs/12 files), paid tier pricing (5,000 URLs/20 files for $0.004 USDC), payment error behavior (x402 v2 PaymentRequired object with fields), retry mechanism, charging rules (invalid input never charged), and fetch behavior (robots.txt respect, user-agent, private address refusal). Highly informative.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loads purpose and discovery mechanism, then tiers, payment, and behaviors. Well-structured and dense with information, but slightly long. Every sentence adds value, though could be marginally tightened.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Complete for a read-only extraction tool: covers discovery, tiers, payment flow, error handling, and fetch constraints. No output schema, but the description implies return format (URLs with lastmod). Annotations cover safety, and description adds extensive behavioral context.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, and the description provides context about the url parameter (domain vs. sitemap file) and bulk (paid tier), but does not add syntax or format details beyond the schema. Baseline 3 is appropriate when schema does the heavy lifting.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb (list/extract) and resource (pages from sitemaps), and details how discovery works (robots.txt, common paths, sitemap indexes). Distinguishes from siblings like robots_txt_check and url_status_check by focusing on sitemap URL extraction with lastmod.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides clear context: use by passing a domain to discover sitemaps or a specific sitemap URL. Describes free vs. paid tiers, when paid is needed (bulk=true), and error handling. However, does not explicitly compare to sibling tools (e.g., when to use this versus seo_meta_tags_check).

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources