Convert Fixed-Width IBGE File to Parquet
ibge_microdata_fixed_width_file_to_parquetConvert IBGE fixed-width microdata TXT files to Parquet using official SAS layouts. Select only needed variables for compact, efficient analysis.
Instructions
Convert a local fixed-width IBGE microdata TXT file into a local Parquet file using an official SAS/TXT input layout.
This is the generic optimization path for repeated analysis: use it for PNAD, POF, or other IBGE microdata families that publish fixed-width TXT files and input layouts. Select only needed variables to keep Parquet files small.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| dataPath | Yes | Local path to an extracted fixed-width microdata TXT file. | |
| rowLimit | No | Optional maximum number of non-empty rows to export, useful for smoke tests or previews. | |
| layoutPath | Yes | Local path to an official IBGE SAS/TXT input layout file. | |
| outputPath | Yes | Local destination path for the Parquet file to create. | |
| selectedVariables | No | Optional variable names to export. If omitted, all layout variables are exported. |