s-fetch-page
Fetch complete web pages with pagination support while avoiding bot detection. Retrieve content in HTML or Markdown format, with metadata on length and truncation. Optimize performance by starting in 'basic' mode and escalating to 'stealth' or 'max-stealth' as needed.
Instructions
Fetches a complete web page with pagination support. Retrieves content from websites with bot-detection avoidance. For best performance, start with 'basic' mode (fastest), then only escalate to 'stealth' or 'max-stealth' modes if basic mode fails. Content is returned as 'METADATA: {json}\n\n[content]' where metadata includes length information and truncation status.
Input Schema
Name | Required | Description | Default |
---|---|---|---|
format | No | Output format (html or markdown) | markdown |
max_length | No | Maximum number of characters to return. | |
mode | No | Fetching mode (basic, stealth, or max-stealth) | basic |
start_index | No | On return output starting at this character index, useful if a previous fetch was truncated and more content is required. | |
url | Yes | URL to fetch |