CreateDIJob
Set up and manage data integration tasks for syncing data between multiple source and destination systems, including real-time, offline, and periodic migrations, with customizable transformation rules and resource allocation.
Instructions
创建数据集成同步任务 *This Tool has a 'MCP Resource',please request CreateDIJob(MCP Resource) to get more examples for using this tool.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| Description | No | 任务的描述 | |
| DestinationDataSourceSettings | Yes | 目标端数据源设置列表 | |
| DestinationDataSourceType | Yes | 目标端数据源类型,枚举值:Hologres,OSS-HDFS,OSS,MaxCompute,LogHub,StarRocks,DataHub,AnalyticDB_For_MySQL,Kafka,Hive | |
| JobName | No | 该字段已废弃,请使用Name字段 | |
| JobSettings | No | 同步任务维度的设置,含DDL处理策略、源端和目标端列数据类型映射策略、任务运行时参数等 | |
| JobType | No | 任务类型,可选-DatabaseRealtimeMigration(整库实时):将源端多个库的多个表进行流同步,支持仅全量,仅增量,或全量+增量。-DatabaseOfflineMigration(整库离线):将源端多个库的多个表进行批同步,支持仅全量,仅增量,或全量+增量。-SingleTableRealtimeMigration(单表实时):将源端单个表进行流同步 | |
| MigrationType | Yes | 同步类型,可选的枚举值有:- FullAndRealtimeIncremental(全量和实时增量,整库实时)- RealtimeIncremental(实时增量,单表实时)- Full(全量,整库离线)- OfflineIncremental(离线增量,整库离线)- FullAndOfflineIncremental(全量+离线增量,整库离线) | |
| Name | No | 任务名称 | |
| ProjectId | No | DataWorks工作空间的ID | |
| ResourceSettings | Yes | 资源设置 | |
| SourceDataSourceSettings | Yes | 源端数据源设置列表 | |
| SourceDataSourceType | Yes | 源端数据源类型,枚举值: PolarDB,MySQL,Kafka,LogHub,Hologres,Oracle,OceanBase,MongoDB,RedShift,Hive,SQLServer,Doris,ClickHouse | |
| TableMappings | Yes | 同步对象转换映射列表,列表中每个元素描述了一组源端同步对象选择规则列表和在该组同步对象上应用的同步对象转换规则列表。>[{"SourceObjectSelectionRules":[{"ObjectType":"Database","Action":"Include","ExpressionType":"Exact","Expression":"biz_db"},{"ObjectType":"Schema","Action":"Include","ExpressionType":"Exact","Expression":"s1"},{"ObjectType":"Table","Action":"Include","ExpressionType":"Exact","Expression":"table1"}],"TransformationRuleNames":[{"RuleName":"my_database_rename_rule","RuleActionType":"Rename","RuleTargetType":"Schema" }]}] | |
| TransformationRules | No | 同步对象转换规则定义列表。>[{"RuleName":"my_database_rename_rule","RuleActionType":"Rename","RuleTargetType":"Schema","RuleExpression":"{\"expression\":\"${srcDatasoureName}_${srcDatabaseName}\"}"}] |