analyze_run
Analyze Databricks job runs using task metrics, Spark plans, and cluster specs to detect anti-patterns, quantify shuffle/skew/spill, and guide cluster sizing.
Instructions
Analyze a Databricks job run from supplied task metrics, Spark plans, executors and cluster specs: anti-patterns, numeric shuffle/skew/spill metrics, plan analysis and cluster sizing.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| run | Yes | ||
| plan | No | ||
| tasks | No | ||
| stages | No | ||
| executors | No | ||
| spark_conf | No | ||
| stage_plans | No | ||
| cluster_specs | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||