clean_rows
Deduplicates, flattens and cleans a list of JSON rows in one call and returns spreadsheet-ready rows (or CSV text) plus a summary with exact counts: rows in, rows added by expansion, duplicates removed, rows dropped by maxItems, rows out, the final column list, per-column fill rates and warnings. Steps, in order: optionally explode one array field into one row per entry; flatten nested objects into columns (address.city becomes address_city); trim text; lowercase valid emails; reduce phone numbers to digits with any leading +; lowercase URL hosts and drop the trailing slash; optionally strip HTML and turn numeric or true/false text into numbers and booleans; blank text becomes null; keep, remove or rename columns; then remove duplicates (normalized by default, comparing the whole row unless dedupKeys is set) keeping the most complete row. Deterministic, no AI, nothing guessed. Use it on scraped leads, CRM exports or API results before loading them anywhere. There is a row limit per call (see list_capabilities); split bigger lists across several calls.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| rows | Yes | The rows to clean. Each row is a JSON object; keys may differ between rows and values may be nested. | |
| flatten | No | Default true. Turn nested objects into flat columns. Arrays become one JSON-text cell. | |
| maxItems | No | Optional cap: read at most this many rows and return at most this many. 0 (default) means no cap. | |
| dedupKeys | No | Fields that identify a duplicate, for example ["Email"]. Empty compares the whole row. Use the final column names: flattened (Details_founded) and renamed. Exact and case-sensitive. Rows where every key is empty count as duplicates of each other. | |
| dedupMode | No | How duplicates are found. normalized (default) ignores case and whitespace; exact needs identical values; fuzzy also merges near-duplicates (up to 100 rows and 1000 characters of key text, so name a short field in dedupKeys); none keeps every row. | |
| stripHtml | No | Default false. Remove HTML tags and decode common entities in text. | |
| cleanFields | No | Default true. Normalize emails, phone numbers and URLs, detected by field name or value shape. | |
| coerceTypes | No | Default false. Turn "42" into 42 and "true" into true. Leading-zero values like "007" stay text. | |
| emptyToNull | No | Default true. Blank text becomes null. | |
| keepStrategy | No | Which duplicate survives: most_complete (default, fewest empty fields), first or last. | |
| outputFormat | No | json (default) returns rows; csv returns the same result as CSV text in "csv" instead. | |
| columnsToKeep | No | Keep only these columns (flattened names). Takes priority over columnsToRemove. | |
| columnRenameMap | No | Rename columns after keep/remove, as ["oldName:newName"] or {"oldName":"newName"}, for example {"Details_founded":"founded"}. | |
| columnsToRemove | No | Drop these columns (flattened names). Ignored if columnsToKeep is set. | |
| dropEmptyFields | No | Default false. Remove null and empty fields from each row. | |
| expandArrayField | No | Optional. One top-level array field (for example "offers") to explode into one row per entry, repeating the other fields. Object entries become columns. The expanded total must stay within the row limit. | |
| flattenSeparator | No | Joins nested key paths when flattening. Default "_". | |
| similarityThreshold | No | Fuzzy mode only. 0.5 to 0.99, default 0.9. Higher is stricter. |