profile_file
Profiles each column in a file in one pass—type, null %, distinct count, min/max, average, median, and top values—to spot data-quality issues before analysis.
Instructions
Profile each column of a file in one pass: type, null %, approximate distinct count, min, max, average, median and the three most common values.
Use it to spot data-quality problems (many nulls, constant columns, odd ranges)
before analysing. columns limits it to named columns; otherwise the first 50
columns are profiled. On a very large file this scans everything and can hit the
time limit - then profile fewer columns.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| path | Yes | ||
| columns | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |