Normalise Arabic text
normalize_arabicClean Arabic text for matching, search and storage: strip diacritics and tatweel, unify alef forms, optional ة→ه and ى→ي, Western digits, Latin punctuation, whitespace. Reports exactly which rules changed the text. Response: result plus data_confidence, estimated_items[], sources[], data_version, warnings[]; deterministic (no AI inside), nothing logged.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | ||
| unify_alef | No | آ أ إ ٱ → ا. | |
| strip_tatweel | No | Remove kashida/tatweel elongation. | |
| strip_tashkeel | No | Remove diacritics (fatha, damma, shadda…). | |
| digits_to_western | No | ٠-٩/۰-۹ → 0-9. | |
| taa_marbuta_to_haa | No | ة → ه (search normalisation; changes spelling). | |
| alef_maqsura_to_yaa | No | ى → ي (search normalisation; changes spelling). | |
| collapse_whitespace | No | ||
| punctuation_to_latin | No | ، ؛ ؟ ٪ ٫ ٬ → , ; ? % . , |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||