etl_schedule_setup
Schedule ETL pipeline runs with cron expressions, choose a scheduler library, and set up dependencies and monitoring for reliable execution.
Instructions
Pro: Set up ETL pipeline scheduling with cron jobs, dependency management, and monitoring
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| api_key | No | API key for authentication | |
| frequency | No | Cron expression for scheduling | 0 */6 * * * |
| pipelines | Yes | Pipeline names to schedule | |
| scheduler | No | Scheduling library | bullmq |