deploy_contract_dq_job
Generates a CDE Airflow DAG from a data contract and deploys it to check live table data against schema and quality rules.
Instructions
Generate DAG from data contract and deploy to Cloudera CDE as an Airflow job.
Creates/updates a CDE files resource (lib/, sql/, DAG) and an Airflow job. Checks live table data against schema and quality rules — no WAP/staging branch.
Args: contract_json: ODCS-compatible contract JSON. cde_user: CDE workload username. cde_password: CDE workload password. cde_endpoint_url: CDE REST/CLI endpoint URL. cdw_connection_id: Airflow CDW connection id (default CDW). schedule: Cron schedule (default daily 0 3 * * *). audit_table: Optional audit table qualified name. force_recreate: Delete and recreate job/resource before deploy. trigger_after_deploy: Trigger a manual CDE job run after deploy.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| cde_user | No | ||
| schedule | No | ||
| audit_table | No | ||
| cde_password | No | ||
| contract_json | Yes | ||
| force_recreate | No | ||
| cde_endpoint_url | No | ||
| cdw_connection_id | No | ||
| trigger_after_deploy | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |