optimize
Analyze PySpark code to optimize performance, recommend join strategies, and suggest partitioning for efficient data processing.
Instructions
Optimize PySpark code and recommend performance improvements.
Modes:
code
Apply optimizations to PySpark code.
Parameters: code (required), optimization_level
joins
Recommend join strategies based on estimated table sizes.
Parameters: pyspark_code (required), table_info
partitioning
Suggest optimal partitioning strategies.
Parameters: pyspark_code (required), table_info
comprehensive
Generate comprehensive optimization recommendations + performance estimates.
Parameters: pyspark_code (required), table_info
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| code | No | ||
| mode | Yes | ||
| table_info | No | ||
| pyspark_code | No | ||
| optimization_level | No | standard |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||