readfetch_crawl
Paid routes require a funded Base USDC wallet. Use readfetch-client / @readfetch/client or the MCP signing proxy (@readfetch/mcp-x402-proxy). Direct calls without a signing client will stop at 402. Start a bounded async crawl from one seed URL. Returns job_id, status (queued), pages_quoted, and price_usd — then poll readfetch_crawl_status with that id until status is complete or failed. A complete job includes per-page url and Markdown in the status payload. Cap scope with max_pages (default 20, max 100) and max_depth (default 2, max 3); include/exclude filter paths by prefix (* suffix on include). Prefer readfetch_batch for a fixed URL list; readfetch_map to list URLs without fetching bodies; readfetch_text for a single page.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "readfetch_crawl"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Seed URL; crawl stays on the same registrable domain. | |
| exclude | No | Path prefixes to skip during the crawl. | |
| include | No | Path prefixes to allow; * suffix wildcard. | |
| max_depth | No | Link depth from the seed URL (default 2). | |
| max_pages | No | Maximum pages to fetch in this job (quoted up front for payment). |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| hint | No | ||
| job_id | No | ||
| status | No | ||
| price_usd | No | ||
| pages_quoted | No |