detect_schema_evolution
Walk through ordered source IDs to detect schema changes over time, including added, removed, or type-changed columns, for monitoring partitioned data.
Instructions
Walk an ordered list of source_ids and report schema changes over time.
Detects: column added (first appearance), column removed (last appearance),
type changed. Useful for monitoring partitioned data (monthly parquets,
API version snapshots) for breaking changes. Output size: small.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| source_ids | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||