glue_schema
Detect schema from sample data, generate evolution strategies for schema changes, and create AWS Glue Data Catalog table definitions.
Instructions
Manage Glue Data Catalog schemas — detect, evolve, and define.
Modes:
detect
Detect schema from sample data and generate table definition.
Parameters: sample_data (required dict/list), table_name (required),
infer_partitions
evolve
Generate schema evolution strategy for handling schema changes.
Parameters: current_columns (required), new_columns (required),
merge_behavior, case_sensitive
catalog
Generate AWS Glue Data Catalog table definition.
Parameters: database_name (required), table_name (required),
s3_location (required), data_format, columns, partition_keys,
enable_schema_evolution
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | Yes | ||
| columns | No | ||
| table_name | No | ||
| data_format | No | parquet | |
| new_columns | No | ||
| s3_location | No | ||
| sample_data | No | ||
| database_name | No | ||
| case_sensitive | No | ||
| merge_behavior | No | merge | |
| partition_keys | No | ||
| current_columns | No | ||
| infer_partitions | No | ||
| enable_schema_evolution | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||