Map a site's declared URLs
map_siteList the URLs a site declares in its sitemaps (found through robots.txt and the well-known paths, each index file walked to its children) without fetching any page. Use it first, to see how big a site is and what sections it has (paths counts its URLs by first path segment), before crawl_site or create_project. It cannot read content (scrape_urls and crawl_site do), and it misses pages a site links to but does not declare. Inputs: any page of the site works as url, since discovery starts at the root. search='/blog/' keeps the blog's URLs; it is a plain case-insensitive substring, not a glob, applied before limit. Cost: 1 credit per sitemap file read (usually 1 in total), never per URL. Needs write access; a read-only connection is refused with code 'read_only'.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "map_site"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Any URL on the site, usually its home page. | |
| limit | No | The most URLs to return, 1 to 5,000 (default 1,000); totals count them all. | |
| search | No | Keep only URLs containing this text; omit for all. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | The site that was mapped. | |
| code | No | Only on a failure: a machine-readable reason, e.g. read_only, validation, plan_limit or not_found. | |
| urls | No | The declared URLs, at most `limit`, filtered by `search`. | |
| error | No | Only when the call failed: what went wrong, in words an assistant can act on. | |
| paths | No | The site by its first path segment, biggest first: [{path, urls}], e.g. {path: '/docs', urls: 412}, '/' for the home page; up to 30, over the first 5,000 declared URLs whatever `limit` returned. What include_paths on crawl_site or create_project would select. | |
| detail | No | Only on a failure: the API's own wording, when the error was rephrased. | |
| method | No | How the sitemaps were found, e.g. through robots.txt. | |
| status | No | Only on a failure: the HTTP status code. | |
| totals | No | Counts over every declared URL and sitemap file, whatever `limit` returned. | |
| sections | No | The section names the sitemaps group URLs under, e.g. 'blog'; empty when there are none. |