web_page_markdown
Fetch web pages or search results and convert them into clean Markdown for AI agents and RAG pipelines, enabling reliable content ingestion without browser overhead.
Instructions
RAG Web Browser Lite — Cheap Markdown for AI Agents
Web search and fetch tool for AI agents and RAG pipelines. Queries Google Search, scrapes the top N pages over raw HTTP, and returns clean Markdown. $0.001 per page plus small platform usage (raw HTTP, no browser).
Pricing (pay per event, billed to your Apify account): Page extracted: $0.001; platform usage billed to your account.
Runs on Apify as subimpact/rag-web-browser-lite.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| gl | No | Two-letter country code for Google Search, e.g. us, my, uk, sg. | us |
| hl | No | Two-letter language code for Google Search, e.g. en, ms, zh. | en |
| query | No | Enter Google Search keywords or a URL of a specific web page. Examples: - <code>san francisco weather</code> - <code>https://www.cnn.com</code> - <code>function calling site:openai.com</code> | https://example.com |
| _maxItems | No | How many dataset items to return to the model (1-1000, default 50). Truncates the response only; it does not change what the Actor collects or charges for. | |
| maxResults | No | The maximum number of top organic Google Search results whose web pages will be extracted. If `query` is a URL, this field is ignored and the Actor only fetches the specific web page. | |
| _maxChargeUsd | No | Per-run spending cap in USD (default 0.5). Passed to Apify as the run option maxTotalChargeUsd, so the run stops when it reaches this charge. | |
| outputFormats | No | Select one or more formats to which the target web pages will be extracted and saved in the resulting dataset. | |
| serpMaxRetries | No | The maximum number of times the Actor will retry fetching the Google Search results on error. | |
| serpProxyGroup | No | Apify Proxy group used for fetching Google Search results. | GOOGLE_SERP |
| proxyConfiguration | No | Apify Proxy configuration used for scraping the target web pages. | |
| removeElementsCssSelector | No | A CSS selector matching HTML elements that will be removed from the DOM before converting to text, Markdown, or saving as HTML. Set to a non-existent selector like `dummy_keep_everything` to disable removal. | nav, footer, script, style, noscript, svg, img[src^='data:'], [role="alert"], [role="banner"], [role="dialog"], [role="alertdialog"], [role="region"][aria-label*="skip" i], [aria-modal="true"] |