ds_create_workflow
Create data workflows by providing SQL statements or defining DAG tasks with dependencies. Set schedules and auto-online to automate production deployment.
Instructions
Create a workflow (supports simple SQL mode and complex DAG mode).
Mode 1 - Simple SQL (backward compatible):
Provide sql_statements + datasource_id
Multiple SQL separated by ";;;" are executed serially
Mode 2 - Complex DAG:
Provide tasks_json + relations_json
tasks_json: JSON array string, each task contains name, taskType, taskParams etc.
relations_json: JSON array string defining task dependencies (preTaskName -> postTaskName)
Args: project_name: Project name name: Workflow name description: Description sql_statements: [Mode 1] SQL, multiple separated by ";;;" datasource_id: [Mode 1] Datasource ID sql_ds_type: [Mode 1] SQL type (HIVE/MYSQL) tasks_json: [Mode 2] Task definition JSON array string relations_json: [Mode 2] Task relation JSON array string schedule: Whether to create a schedule schedule_cron: Quartz 7-field cron expression schedule_start: Schedule start time (defaults to today) schedule_end: Schedule end time (defaults to 2030-12-31) auto_online: Whether to auto-release workflow and schedule
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| schedule | No | ||
| tasks_json | No | ||
| auto_online | No | ||
| description | No | ||
| sql_ds_type | No | HIVE | |
| project_name | Yes | ||
| schedule_end | No | ||
| datasource_id | No | ||
| schedule_cron | No | 0 0 6 * * ? * | |
| relations_json | No | ||
| schedule_start | No | ||
| sql_statements | No |