export_dataset
Export per-page source, page, and text data to a parquet or JSONL file, optionally filtering by a specific source. Ideal for saving crawled or processed data for analysis or sharing.
Instructions
Write the per-page {source, page, text} dataset to a file (no vectors).
fmt is parquet/jsonl (empty infers from the suffix); source limits to one file.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| fmt | No | ||
| output | Yes | ||
| source | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||