normalize_tokens
Normalizes a list of tokens into canonical identifiers, converting glyphs and domain-specific terms for consistent processing.
Instructions
Normalize glyphs and known domain terms into canonical IDs.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | No | ||
| tokens | Yes |