spidra_scrape
Extract and compare content from up to three known URLs using AI. Returns a single combined answer with raw page markdown, ideal for summarizing or comparing related pages.
Instructions
Scrape 1-3 known URLs and extract their content with AI. This tool WAITS for the result (typically 10-60 seconds) and returns the extracted content directly.
IMPORTANT: with multiple URLs, their content is COMBINED and the AI produces ONE answer across all of them (the per-URL raw pages are still returned in "pages"). Use several URLs here when you want to compare or synthesize across pages — e.g. "compare the pricing on these two pages". If instead you want the SAME extraction run separately on each URL (own result per URL), use spidra_batch_scrape even for just 2 URLs.
Best for: one URL, or one combined answer drawn from 2-3 related URLs. Not for: per-URL independent results (use spidra_batch_scrape) or discovering pages on a site (use spidra_crawl).
Behavior notes:
Omit "prompt" and "schema" to get the raw page content as markdown.
Pass "prompt" for free-form AI extraction, and add "schema" when you need a guaranteed JSON shape. Define every field in the schema — untyped objects come back empty.
Use "actions" to interact with the page first (dismiss cookie banners, type into search boxes, scroll, or loop over elements with forEach).
Use "useProxy" with "proxyCountry" for geo-restricted or bot-protected sites.
Costs: 2 credits per URL plus AI tokens; CAPTCHA solves cost 10 credits each.
Usage example:
{
"name": "spidra_scrape",
"arguments": {
"urls": ["https://example.com/pricing"],
"prompt": "Extract all pricing plans with name, price, and included features",
"output": "json"
}
}Returns: extracted content plus token/credit stats. If the wait window is exceeded, the job keeps running — poll spidra_check_scrape_status with the returned jobId.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | 1-3 URLs to scrape in parallel | |
| output | No | Output format (default "markdown") | |
| prompt | No | What to extract, in plain English. Omit for raw markdown. | |
| schema | No | JSON Schema enforcing the exact output shape. Define EVERY field you want extracted — an untyped object with no properties comes back empty. Missing fields return null instead of hallucinated values. | |
| actions | No | Browser actions to run on each URL before extraction, in order | |
| cookies | No | Raw Cookie header string for pages behind a login, e.g. "session=abc" | |
| useProxy | No | Route through a residential proxy (for blocked/geo-restricted sites) | |
| scrapeMode | No | "fast" = HTTP only (no browser), cheaper but less capable | |
| screenshot | No | Capture a viewport screenshot (URL returned) | |
| proxyCountry | No | Two-letter country code for the proxy, e.g. "us", "de", "jp", or "eu"/"global" | |
| extractContentOnly | No | Strip navigation/ads/boilerplate before extraction |