fetch_dataset
Pull a full dataset through the SODA API and cache it as Parquet for SQL cross-referencing; use $where or $select filters to limit rows before download.
Instructions
Pull every row of a dataset via the SODA API and cache it as Parquet (data/raw/.parquet), so it can be cross-referenced in SQL. Supports a server-side $where filter and $select projection. Re-running overwrites the cache; check describe_dataset's cached/fetched_at first to avoid re-pulling time-sensitive data unnecessarily. Large datasets (millions of rows) take time; prefer a $where filter when a subset suffices.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| where | No | ||
| select | No | ||
| dataset_id | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||