arabic_normalize
Normalize Arabic text with configurable Unicode rules to prepare it for search, RAG, and deduplication.
Instructions
Normalize Arabic text with individually controlled Unicode rules.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | ||
| unify_yeh | No | ||
| unify_alef | No | ||
| remove_tatweel | No | ||
| strip_diacritics | No | ||
| unify_teh_marbuta | No | ||
| collapse_repeated_letters | No | ||
| remove_control_characters | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| lossy | Yes | ||
| method | No | unicode-rules-v2 | |
| changed | Yes | ||
| original | Yes | ||
| warnings | No | ||
| normalized | Yes | ||
| transformations_applied | Yes |