arabic_prepare_for_search
Normalize Arabic/mixed text for search, RAG, and deduplication. Returns tokens, stable fingerprint, and transformation audit trail for reliable matching.
Instructions
Prepare Arabic/mixed text for search, RAG, and deduplication.
Returns normalized tokens, a stable SHA-256 fingerprint, lossiness, warnings, and the exact transformation audit trail.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | ||
| profile | No | search |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| lossy | Yes | ||
| method | No | arabic-search-preparation-v1 | |
| tokens | Yes | ||
| changed | Yes | ||
| profile | Yes | ||
| original | Yes | ||
| warnings | No | ||
| fingerprint | Yes | ||
| search_text | Yes | ||
| transformations_applied | Yes |