scrape_with
Run any registered scraper by name and get its raw scrape() output. Use this generic dispatcher to invoke built-in or plugin scrapers from the registry.
Instructions
Run any registered scraper (built-in or plugin) by name and return that scraper's raw scrape() output.
This is the generic dispatch entry point for scrapers that lack a dedicated tool, notably third-party plugins. It looks up the scraper in the registry, calls its scrape() method with the given args, and returns whatever that scraper returns (typically a dict or list of records; exact shape is scraper-specific). Side effects and requirements (network requests, browser/headless rendering, auth) depend entirely on the target scraper. If name is not a registered scraper, it raises an error rather than returning empty; if the scraper runs but finds nothing, it returns that scraper's empty result (e.g. an empty list).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| args | No | Dict of keyword arguments forwarded to the named scraper's scrape() method; required keys depend on that scraper. Example: {"query": "Alan Turing", "lang": "en"}. No default (required). | |
| name | Yes | String, the scraper's registered name from list_available_scrapers. Example: "wikipedia". No default (required). |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| data | No | ||
| count | No | ||
| errors | No | ||
| scraper | No | ||
| source_urls | No |