web_extract
Fetch any public web page and extract its readable content as clean markdown. Respects robots.txt, handles redirects, ideal for research and RAG.
Instructions
[costs $0.03 USDC per call] Fetch a web page and extract its readable content as clean markdown. Web scraping API: fetch any public web page and get its readable content as clean markdown — title, author, canonical URL, boilerplate stripped. Honest User-Agent, robots.txt honored (explicit Disallow returns an unpaid 403), private/internal targets refused, at most 3 safety-revalidated redirects, 1MB input / 100k character output caps. HTML pages only. Use for research agents, content extraction, summarization pipelines, and RAG ingestion. Cached up to 5 minutes per URL.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute http(s) URL of the page to extract. |