transform_data
Transform a dataset by applying operations such as filter, groupby, sort, or derive, saving the result as a new dataset.
Instructions
Transform a dataset using common operations. Saves the result as a new dataset.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| agg | No | Aggregation function for groupby — mean, sum, count, min, max, median, std | mean |
| limit | No | Limit number of rows in output | |
| value | No | Filter value or expression (e.g. '> 5', '== "setosa"', 'in ["A","B"]') | |
| column | No | Column to operate on (for filter/sort) | |
| sort_by | No | Column to sort by | |
| group_by | No | Column(s) to group by (comma-separated for multiple) | |
| ascending | No | Sort ascending (default True) | |
| operation | Yes | One of 'filter', 'groupby', 'sort', 'derive', 'sample', 'drop_na', 'pivot' | |
| expression | No | Python expression for derive (e.g. 'col_a * col_b') | |
| new_column | No | Name for derived column | |
| output_name | No | Name for the resulting dataset (auto-generated if not provided) | |
| dataset_name | Yes | Source dataset name |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |