scrape
Extract structured fields from any URL by describing them in plain language, with caching, pagination, and optional LLM-based selector discovery.
Instructions
Extract structured fields from a web page.
`fields` is comma-separated with optional inline types, e.g.
"title, price:float, in_stock:bool". Field names are arbitrary.
A field that could not be extracted comes back as null with an entry in
`misses` explaining why -- that is a normal result, not a failure.
Cost control: `no_llm=True` uses only structured data and already-cached
selectors, so the call is free; `max_llm_calls` caps what an uncached page
may spend. `scroll` and `paginate` cost extra fetches, not extra tokens.
There is no `strict`: it exists on the CLI only to pick an exit code, and
`misses` already tells you what was not found.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| mode | No | auto | |
| fields | Yes | ||
| no_llm | No | ||
| scroll | No | ||
| refresh | No | ||
| no_cache | No | ||
| paginate | No | ||
| cache_ttl | No | ||
| max_llm_calls | No |
Output Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| mode | Yes | ||
| misses | No | field name -> why it is null. A populated misses is a result, not an error. | |
| records | Yes | ||
| llm_calls | No |