Fetch a web page as Markdown
ai_web_fetchFetch an HTTP/HTTPS page and convert its main article into clean Markdown with title, byline, final URL, and word count. Target content with a CSS selector or save the Markdown to a file.
Instructions
Fetch a web page (http/https) and return its readable content as clean Markdown, with title, byline, final URL after redirects and a word count. Uses Mozilla Readability to keep the main article (falls back to the whole page), or a CSS "selector" you give. Respects robots.txt (refuses pages disallowed for the s3eidat-tools-mcp user agent), only reads HTML and text responses, stops at 5 MB and 20 seconds, follows up to 5 redirects, and refuses private, local and loopback addresses unless allowPrivate is true. Does not run JavaScript, so pages that build their content in the browser may come back nearly empty. Inline Markdown is cut at maxChars (default 200k); "output" saves it to a file.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The page to fetch (http:// or https://). | |
| output | No | Write the Markdown to this file (or folder ending in "/") and return its path instead of the inline text. | |
| maxChars | No | Cut the inline Markdown after this many characters, with a note (a file written with "output" is never cut). Default 200000. | |
| readable | No | Keep only the main content (default true). False converts the whole page body. | |
| selector | No | CSS selector: convert only the matching elements instead of the Readability main content. | |
| allowPrivate | No | Allow private, local and loopback hosts (e.g. a dev server on localhost). Default false. | |
| includeLinks | No | Keep links (made absolute) and images. False turns links into plain text and drops images. |