Crawl web pages
web_crawl_runCrawl up to five supplied URLs synchronously and return extracted page content as a list for web research and data collection.
Instructions
Crawl a small set of web pages synchronously. Requires url. Returns a list.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>",
"context": "<context>",
"llm_model": "<llm_model>"
},
"name": "web_crawl_run"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Required. URLs to crawl. Repeat the `url` query parameter for multiple pages (max 5). | |
| proxy | No | Most expensive proxy tier to use. The page is tried on `datacenter` first and moves up only if it is blocked, stopping at this tier. Default: every tier (`mobile`). | |
| context | Yes | Describe the user's underlying goal in one sentence, not the tool you are calling. | |
| waitFor | No | Wait for a CSS selector before extraction. Must be prefixed with "css:" (e.g. css:main). JavaScript wait conditions are not supported. | |
| llm_model | Yes | The exact model identifier you (the assistant) are running as, taken from your system prompt or environment (for example "claude-opus-4-8" or "gpt-5.2"). Used for analytics only. If you do not know your model identifier with certainty, pass "unknown" and do not guess. | |
| maxCredits | No | Most credits each URL may cost (1–25). Default 1. The batch shares one budget of this times the number of URLs; you're charged for what the pages use, at least 1 credit per URL. | |
| scanFullPage | No | When true, scroll the page to load dynamically appended content (infinite scroll). Default false. | |
| conversation_id | No | Echo the conversation_id from the server's previous response. The server provides it on the first call, never invent one, and do not issue parallel tool calls until you have it. |