web_scrape
Convert a public URL into clean, LLM-ready Markdown to read one web page, with optional link extraction and browser rendering for JavaScript content.
Instructions
Web Scrape (URL to Markdown) — URL to Markdown web scraper: read any web page as clean, LLM-ready Markdown. Default tool for reading ONE web page whose URL you have: returns clean Markdown (title, meta description, main content with headings, lists and links); Markdown and plain-text files such as llms.txt or README.md come back unchanged. The fastest and cheapest way to give an LLM the content of a page. If a JavaScript app comes back nearly empty, set render:true (real browser, slower, plain text) or use webpage-reader. For 2 to 5 URLs use web-read-batch, for 6 to 20 web-scrape-batch (one payment), for a whole site site-crawl, and if you have a question but no URL search-read. Params: url (required), max_chars (default 8000, max 60000), include_links, render. Cost: $0.0025 USDC per call. Latency p99: 3500ms.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public http(s) URL to scrape | |
| render | No | Render with a headless browser (for JavaScript-heavy pages). Returns plain text instead of Markdown. | |
| max_chars | No | Truncate Markdown after this many characters | |
| include_links | No | Also return up to 100 absolute links found on the page |