analyze_stage
Diagnose a Spark stage by examining shuffle, skew, spill, and GC metrics, slowest tasks, anti-patterns, and query-plan details to pinpoint performance bottlenecks.
Instructions
Deep-dive one Spark stage of a run: shuffle/skew/spill/GC numbers, slowest tasks, anti-patterns and a detailed analysis of the stage's query plan.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| job_id | No | ||
| run_id | Yes | ||
| stage_id | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||