Read URL
scrape_urlReads one public web page by URL and returns its content as markdown (text, truncated, total_chars). Use it when the URL is known; it does not search (use google_search), and Zillow or eBay URLs are refused free (use search_zillow or search_ebay). Costs 1 credit, 5 with render_js, 10 with premium or challenge_mode, 25 with render_js and premium; blocked or empty pages are not charged. A page not ready within 25 seconds returns a job_id instead; async=true returns one at once. Poll with the same url and job_id; jobs are kept 1 hour. Required: url.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "scrape_url"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public http or https page URL, at most 8192 characters, e.g. "https://example.com/pricing". Private network addresses and sign-in pages are refused; Reddit URLs are read from the public feed. | |
| async | No | true returns {job_id, status, retry_after} at once instead of waiting; false (default) waits up to 25 seconds and returns a job_id only if the page is not ready by then. Boolean, e.g. true. | |
| job_id | No | job_id from an earlier scrape_url call: job_ followed by 64 lowercase hex characters. Send it with the same url to read the result; polling starts no new scrape and costs nothing. Jobs are kept 1 hour. Omit to start a new scrape. | |
| premium | No | Fetch through residential proxies, for pages that come back blocked or empty. Boolean, default false; 10 credits, 25 with render_js. | |
| max_chars | No | Maximum markdown characters returned in text, integer 1000-30000, default 12000, e.g. 5000. Longer pages are cut and truncated is true; total_chars gives the full length. Ignored when max_tokens is set. | |
| render_js | No | Run the page's JavaScript in a browser before reading it, for pages built in the browser. Boolean, default false; 5 credits instead of 1. | |
| max_tokens | No | Token limit, integer 1-1000000, estimated at about 4 characters per token, e.g. 2000; replaces max_chars. Over it, text is cut and content_id/content_url fetch the full page for 1 hour with the same API key, at no extra charge. No default. | |
| challenge_mode | No | Separate browser mode for pages that answer with a browser verification check. Boolean, default false; 10 credits. Cannot be combined with premium or render_js. | |
| idempotency_key | No | Caller-chosen key, 1-128 characters, e.g. "order-42-pricing". A repeat call with the same key and options returns the same job instead of scraping and charging again; the same key with other options is rejected. Omit to start a new job on every call. |