aggregate_crawl_data
Aggregate crawl data exports to get total row counts and group-by breakdowns. Use for counting issues like 404s or status code distributions.
Instructions
Aggregate CSV data from an export: row counts and group-by breakdowns. Use instead of read_crawl_data when the question needs counts or a distribution ("how many 404s", "status code breakdown") rather than the rows themselves.
Args: export_id: The export_id from export_crawl file: CSV filename to aggregate (from the file list in export_crawl output) group_by: Optional column name; counts rows per distinct value of it top: Max distinct values to show, most common first (default 20, max 100) filter_column: Optional column name to filter by before aggregating filter_value: Optional value to match in the filter column filter_mode: How to match filter_value: "contains" (default), "exact", or "regex"
Returns: Total matching row count, plus per-value counts with percentages when group_by is set.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| export_id | Yes | ||
| file | Yes | ||
| group_by | No | ||
| top | No | ||
| filter_column | No | ||
| filter_value | No | ||
| filter_mode | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |