Merge lists and remove duplicate rows (lite, up to 200 rows)
merge_dedupe_rowsMerge 1-5 lists of JSON rows (e.g. the results of two scrapers or two CSV exports) into one clean list: remove duplicates by the fields you choose (case, accents and extra spaces ignored), keep the first or last copy or merge their fields, and optionally return only the rows that are not in a previous list ("only new rows"). Free up to 200 rows per call; for bigger files, CSV/Excel/Google Sheets or scheduled runs it points to the full Merge, Filter, Deduplicate & Transform Datasets Actor on Apify.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| keep | No | Which copy to keep: first (default), last, or merge (first copy, empty fields filled from the others) | |
| rows | No | Alternative to datasets: one list of rows to deduplicate | |
| exact | No | true = compare values exactly (default false: ignore case, accents and extra spaces) | |
| datasets | No | 1-5 lists of rows to merge, e.g. [[{"email":"a@x.com"}],[{"email":"A@x.com "}]] | |
| dedupe_by | No | Fields that identify a duplicate, e.g. ["email"] or ["name","city"]. Empty = the whole row | |
| previous_rows | No | Rows you already have: matching rows are removed so only NEW rows come back |