Scrape a single webpage and extract its content.

This tool can scrape web pages using different methods:

• auto: Automatically choose the best method

• simple: Fast HTTP requests (no JavaScript)

• scrapy: Robust scraping with Scrapy framework

• selenium: Full browser rendering (supports JavaScript)

You can specify extraction rules to get specific data from the page.

Scrape multiple webpages concurrently.

This tool allows you to scrape multiple URLs at once, which is much faster than scraping them one by one. All URLs will be processed concurrently.

Extract all links from a webpage.

This tool is specialized for link extraction and can filter links by domain, extract only internal links, or exclude specific domains.

Get basic information about a webpage (title, description, status).

This is a lightweight tool for quickly checking page accessibility and getting basic metadata without full content extraction.

Check the robots.txt file for a domain to understand crawling permissions.

This tool helps ensure ethical scraping by checking the robots.txt file of a website to see what crawling rules are in place.

Scrape a webpage using advanced stealth techniques to avoid detection.

This tool uses sophisticated anti-detection methods including:

• Undetected browser automation

• Randomized behavior patterns

• Human-like interactions

• Advanced evasion techniques

Use this for websites with strong anti-bot protection.

Fill and optionally submit a form on a webpage.

This tool can handle various form elements including:

• Text inputs

• Checkboxes and radio buttons

• Dropdown selects

• File uploads

• Form submission

Useful for interacting with search forms, contact forms, login forms, etc.

Get server performance metrics and statistics.

Returns information about:

• Request counts and success rates

• Performance metrics

• Method usage statistics

• Error categories

• Cache statistics

Clear the scraping results cache.

This removes all cached scraping results, forcing fresh requests for all subsequent scraping operations.

Extract structured data from a webpage using advanced techniques.

Automatically detects and extracts:

• Contact information (emails, phone numbers)

• Social media links

• Addresses

• Prices and product information

• Article content

data_type can be: all, contact, social, content, products, or addresses