extract_web_content
Extract clean, token-optimized Markdown from any webpage, removing noise for efficient LLM consumption. Handles anti-bot challenges with optional deep crawl mode.
Instructions
Extract token-optimized clean Markdown content from a target website for LLM consumption.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Target website URL to extract content from. | |
| mode | No | Crawl mode: 'fast' (native HTTP fetch) or 'deep' (headless Playwright browser with JS execution). | fast |
| proxy | No | Optional HTTP/SOCKS5 proxy URL (e.g. 'http://proxy.example.com:8080'). | |
| cookies | No | Optional custom HTTP cookies key-value dictionary. | |
| headers | No | Optional custom HTTP request headers key-value dictionary. | |
| max_retries | No | Maximum retry attempts for transient errors or rate limits (default: 3). | |
| css_selector | No | Optional CSS selector to scope content extraction to a specific HTML node. |