Read a web page
ragfeed_scrapeFetch one web page or document and return its main content as compact markdown for language models (navigation, ads and boilerplate removed). Optionally answer a question about the page or summarize it. Costs 1 credit per page; summary or question add 5 (very long answers 5 more per further 2000 tokens).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Full http(s) address of the page or document (HTML, PDF, Word, Excel, …). | |
| fresh | No | Fetch the page live now; by default a copy up to two days old may be used. | |
| format | No | llm_markdown: compact text for AI (default). markdown: full markdown. html: cleaned HTML. links: all links on the page. summary: a short summary. | llm_markdown |
| mobile | No | Fetch the mobile version. | |
| offset | No | Start of the part to return (for long pages). | |
| question | No | A question to answer from the page content. | |
| max_chars | No | Longest text to return; longer pages come in parts. | |
| wait_for_ms | No | Extra wait for pages that load content with JavaScript. | |
| only_main_content | No | Drop header, footer and navigation. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | Address of the page. | |
| error | No | Only on failed calls (isError true). | |
| title | No | Page title. | |
| answer | No | Answer to the question from the page. | |
| format | No | The requested format. | |
| offset | No | Start of this part. | |
| content | No | The page text in the requested format (this part, see offset and nextOffset). | |
| summary | No | Summary of the page (format summary). | |
| warning | No | Anything unusual about the page. | |
| archived | No | Served from the web archive because the site blocked the request. | |
| question | No | The question asked. | |
| nextOffset | No | Offset for the next part; null when nothing is left. | |
| statusCode | No | HTTP status of the page. | |
| totalChars | No | Length of the whole text. |