Fetch a web page as Markdown
fetch_pageRead one public web page and return its main content as clean Markdown: headings, paragraphs, lists, quotes, code blocks, tables and absolute links, without menus, footers, scripts or cookie banners. Also returns the title, description, language, canonical address and up to 100 links from the content. robots.txt is checked first and a disallowed page is skipped with the reason. It never signs in, passes a paywall, solves a CAPTCHA or runs page scripts. Pass max_chars for more than 20000 characters.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Full address of one public web page, such as "https://example.com/docs/intro". http is upgraded to https. | |
| links | No | Set false to leave out the link list. Default true: up to 100 distinct links from the main content. | |
| max_chars | No | Longest Markdown to return, cut at a block end. Default 20000. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| lang | No | ||
| note | Yes | ||
| chars | No | ||
| links | No | ||
| notes | No | ||
| title | No | ||
| words | No | ||
| reason | No | ||
| status | Yes | ||
| message | No | ||
| markdown | No | ||
| canonical | No | ||
| final_url | No | ||
| truncated | No | ||
| fetched_at | No | ||
| from_cache | No | ||
| description | No | ||
| links_total | No | ||
| content_type | No | ||
| untrusted_source | Yes | ||
| retry_after_seconds | No |