Website page list (site map)
site_mapUse it when an agent needs to know what pages a website has before reading them: where is the pricing page, which docs pages exist, what did the blog publish lately, which product or careers pages are there. Give any URL on the site; returns the site's page URLs with their last-modified dates, like Firecrawl's /map. Reads the sitemaps named in robots.txt, else /sitemap.xml and /sitemap_index.xml, following sitemap indexes (up to 10 child sitemaps, 20,000 URLs) and gzip (.xml.gz) sitemaps; a site with no sitemap is mapped from its home page's links on the same host. Filter with search (every word must appear in the URL, title or date, e.g. "pricing" or "blog 2026") and path_prefix (e.g. "/docs/"); limit up to 1,000 (default 200). next_calls read the first matches with scrape_batch. When the site cannot be reached (502) or no page matches (404), you are not charged. No account or API key. Costs $0.002 USDC per call via x402. Paid per call with x402 inside MCP (see the server instructions).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The website, or any page on it, e.g. https://example.com. Its origin (scheme and host) is mapped. | |
| via | No | Optional: the tool whose next_calls suggested this call (filled in for you). | |
| limit | No | How many URLs to return (1-1,000, default 200). | |
| search | No | Only URLs containing every word of this text (case-insensitive) in the URL, or in the title or lastmod when known, e.g. "pricing" or "blog 2026". | |
| path_prefix | No | Only URLs whose path starts with this, e.g. "/blog/" or "/docs". |