deploy_to_kafka
Create a deployable Flink job that streams query results into a Kafka topic, with SELECT logic verified against sample data first.
Instructions
Produce a deployable topic->topic Flink job: INSERT INTO a Kafka sink topic SELECT ... The SELECT logic is verified on the sample data by running it on real Flink; the returned deployable_sql is the full pipeline (upsert-kafka sink for updating jobs). Use when the user wants to WRITE results to a Kafka topic, not just query them.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| request | Yes | ||
| sources | Yes | Source tables. Each: name, columns [[name, flinkType], ...], event_time (column), watermark_delay_seconds, optional primary_key. | |
| bootstrap | No | ||
| sink_topic | Yes | Destination Kafka topic. | |
| sample_data | Yes | Map of source name -> list of row objects. TIMESTAMP columns may be integer seconds (offset from a base) or a 'yyyy-MM-dd HH:mm:ss.SSS' string. |