scrape_with_stealth
Scrape websites with strong anti-bot protection using advanced stealth techniques like undetected browser automation, randomized behavior patterns, and human-like interactions to avoid detection.
Instructions
Scrape a webpage using advanced stealth techniques to avoid detection.
This tool uses sophisticated anti-detection methods including:
Undetected browser automation
Randomized behavior patterns
Human-like interactions
Advanced evasion techniques
Use this for websites with strong anti-bot protection.
Input Schema
Name | Required | Description | Default |
---|---|---|---|
request | Yes |
Input Schema (JSON Schema)
{
"$defs": {
"StealthScrapeRequest": {
"description": "Request model for stealth scraping operations.",
"properties": {
"extract_config": {
"anyOf": [
{
"additionalProperties": true,
"type": "object"
},
{
"type": "null"
}
],
"default": null,
"description": "Configuration for data extraction",
"title": "Extract Config"
},
"method": {
"default": "selenium",
"description": "Stealth method: selenium or playwright",
"title": "Method",
"type": "string"
},
"scroll_page": {
"default": false,
"description": "Whether to scroll page to load dynamic content",
"title": "Scroll Page",
"type": "boolean"
},
"url": {
"description": "URL to scrape using stealth techniques",
"title": "Url",
"type": "string"
},
"wait_for_element": {
"anyOf": [
{
"type": "string"
},
{
"type": "null"
}
],
"default": null,
"description": "CSS selector to wait for",
"title": "Wait For Element"
}
},
"required": [
"url"
],
"title": "StealthScrapeRequest",
"type": "object"
}
},
"properties": {
"request": {
"$ref": "#/$defs/StealthScrapeRequest",
"title": "Request"
}
},
"required": [
"request"
],
"type": "object"
}