Web Scraper
scrapeTurn any public web page into clean, LLM-ready Markdown, raw HTML or JSON fields picked with CSS selectors. Optional JavaScript rendering, screenshots and an automatic residential-proxy fallback when a site blocks. Costs from 1 credit per result; failed items are free.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "scrape"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | The page to scrape. | |
| urls | No | Several pages in one run (up to 20); one result per page. | |
| proxy | No | auto: direct first, residential proxy only if the site blocks us. none: never a proxy. residential: always. | auto |
| format | No | markdown: clean, LLM-ready text of the page. html: the page HTML. json: the fields from `extract`. | markdown |
| country | No | Exit country for the residential proxy (two-letter code). | |
| extract | No | For format json: field name -> CSS selector, or {selector, attribute, all}. attribute reads e.g. href/src/content ("html" = inner HTML); all returns every match. | |
| waitFor | No | With renderJs: a CSS selector to wait for, or a delay in milliseconds (e.g. 2000, max 15000). | |
| renderJs | No | Load the page in a headless browser first (for sites that build their content with JS). | |
| timeoutMs | No | Per page, for loading (and rendering). | |
| screenshot | No | With renderJs: a PNG of the viewport, returned as a signed download URL (valid 7 days). | |
| onlyMainContent | No | Markdown: drop navigation, cookie banners, sidebars and footers. |