Crawl a website and extract content from multiple pages. Follows links up to the specified depth/limit. Returns content in markdown, HTML, text, or other formats. Powered by Spider — crawls 100K+ pages/sec with smart JS rendering.

Scrape a single page and extract its content. No link following — fetches and processes one URL. Faster and cheaper than crawling. Supports all output formats and optional screenshot capture.

Search the web and optionally fetch full page content from results. Supports location, language, and time range filters. Set fetch_page_content=true to get full page data, not just URLs.

Extract all links from a page without fetching their content. Fast way to discover URLs on a site for further processing.

Capture a screenshot of a web page. Returns base64-encoded PNG by default. Supports full-page capture and custom viewports.

Access content from bot-protected websites. Uses advanced anti-bot bypass with fingerprinting and proxy rotation. Costs 10-40 extra credits per successful unblock on top of base scrape cost.

Transform HTML content to markdown, text, or other formats without making any web requests. Use when you already have HTML and need to convert it.

Check your available Spider API credit balance. Returns the number of credits remaining on your account.

AI-guided website crawling. Describe what you want in plain English and Spider's AI optimizes the crawl automatically. Requires an active AI subscription (https://spider.cloud/ai/pricing).

Extract structured data from a page using plain English. Describe the data you need and get clean JSON back — no CSS selectors required. Requires an active AI subscription (https://spider.cloud/ai/pricing).

AI-enhanced web search with intent understanding and relevance ranking. Requires an active AI subscription (https://spider.cloud/ai/pricing).

AI-powered browser automation using natural language. Describe what to do and Spider automates the browser — click buttons, fill forms, navigate pages. Requires an active AI subscription (https://spider.cloud/ai/pricing).

AI-powered link extraction and filtering. Describe which links you want and the AI finds and categorizes them. Requires an active AI subscription (https://spider.cloud/ai/pricing).

Open a new remote browser session in Spider's cloud. Returns a session_id for use with other browser tools. The browser comes with anti-bot protection and proxy rotation. Sessions auto-close after 5 minutes of inactivity. Always close sessions with spider_browser_close when done to avoid unnecessary charges.

Navigate the browser to a URL. Waits for the page to finish loading before returning the URL and title.

Click an element on the page. Waits for the element to appear before clicking.

Fill a form field with text. Clears existing content first, then types the new value. Use for text inputs, textareas, and contenteditable elements.

Take a screenshot of the current page. Returns a base64-encoded PNG image. Use for visual verification, debugging, or capturing page state.

Get the current page content. Returns the full HTML or extracted text of the page.

Execute JavaScript in the browser page and return the result. The expression is evaluated in the page context with access to the DOM. Use for advanced interactions, data extraction, or anything not covered by other browser tools.

Wait for a condition on the page. Use after navigation or actions that trigger dynamic content loading.

Close a browser session and release its resources. Always call this when done with a browser session to stop billing.