Metis ยท Software Engineer โ Generate Profiling Script
generate_profiling_scriptGenerates a safe profiling script that computes dataset aggregates like variable names, types, ranges, and missingness without exposing row-level data.
Instructions
Generate a safe profiling script tailored to a specific dataset.
The generated script runs on the user's machine and reports ONLY
aggregates: variable names, types, unique counts, ranges, missingness,
and value frequencies (capped at 30 levels). No row-level data leaves
the machine. Output is structured JSON matching the register_data_dictionary
schema, ready for ingest_profiling_output().
If data_dictionary entries already exist for this dataset, the script
includes checks for those specific variables.
Args:
dataset_name: Name of the dataset (used in filenames and DB).
project_id: Project ID for looking up existing variable info.
language: "r" or "python" (default "r").
dataset_path: Path to the data file on disk. If empty, a placeholder is used.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| language | No | r | |
| project_id | No | ||
| dataset_name | Yes | ||
| dataset_path | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |