Manage pipelines
manage_pipelineCreate, inspect, update, clone, or delete Lakeflow Spark Declarative Pipelines (DLT) in Databricks, including listing, pagination, and safe destructive confirmations.
Instructions
Create, inspect, change, clone and delete Lakeflow Spark Declarative Pipelines (DLT).
create: spec = pipeline settings (name, catalog, schema, libraries [{notebook:{path}} | {file:{path}} | {glob:{include}}], root_path, serverless, clusters, configuration, continuous, development, channel, edition, photon, notifications, tags, trigger, environment, event_log, run_as, ...).
get (pipeline_id), list (name_contains or filter; paginated).
update (pipeline_id, spec): the given top-level fields are merged onto the current settings (set a field to null to remove it); uses expected_last_modified to avoid overwriting concurrent edits.
delete (pipeline_id[, cascade, force]): DESTRUCTIVE, needs confirm. By default tables are deleted too.
clone (pipeline_id, spec: catalog, schema/target, clone_mode='MIGRATE_TO_UC', ...): HMS -> UC copy. Run/monitor updates with manage_pipeline_run. Specs with run_as are SECURITY_SENSITIVE.
Safety classification: depends on input (DESTRUCTIVE, EXECUTION, READ_ONLY, SECURITY_SENSITIVE, WRITE).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| spec | No | Request body fields for create/update, using the Databricks REST API field names (snake_case). Unknown fields are rejected. | |
| force | No | delete: proceed even if resource cleanup fails. | |
| action | Yes | create: new pipeline from spec; get: full definition and state; list: pipelines; update: change settings (merged onto the current spec); delete: delete pipeline; clone: copy a Hive-metastore pipeline to Unity Catalog (starts an update on the clone). | |
| filter | No | list: raw server filter, e.g. "notebook='/Users/me/nb'" or "name LIKE '%sales%'". | |
| cascade | No | delete: false keeps the pipeline's tables/views (server default true deletes them). | |
| confirm | No | Set to true ONLY after the user has reviewed the plan returned by a previous call with status 'confirmation_required'. Required for destructive/security-sensitive actions. | |
| dry_run | No | If true, validate and return the planned change without executing it. | |
| page_size | No | Max items to return (server caps this). | |
| page_token | No | next_page_token from a previous response. | |
| pipeline_id | No | Pipeline id (get/update/delete/clone). | |
| name_contains | No | list: only pipelines whose name contains this text (server-side LIKE). |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| data | No | ||
| page | No | ||
| plan | No | ||
| tool | Yes | ||
| action | No | ||
| safety | No | ||
| status | No | success | |
| summary | Yes | ||
| warnings | No | ||
| next_steps | No | Suggested follow-up calls. | |
| request_id | No |