optimize
Analyze PySpark code to recommend performance improvements, including join strategies and partitioning. Supports targeted modes and comprehensive analysis with performance estimates.
Instructions
Deprecated. Prefer review. Still registered this minor version.
Optimize PySpark code and recommend performance improvements.
Modes:
code
Return pattern-based suggestions for PySpark code. Does not rewrite
the input. Parameters: code (required), optimization_level
joins
Recommend join strategies based on estimated table sizes.
Parameters: pyspark_code (required), table_info
partitioning
Suggest optimal partitioning strategies.
Parameters: pyspark_code (required), table_info
comprehensive
Generate comprehensive optimization recommendations + performance estimates.
Parameters: pyspark_code (required), table_info
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| code | No | ||
| mode | Yes | ||
| table_info | No | ||
| pyspark_code | No | ||
| optimization_level | No | standard |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||