critical_tokenize
Tokenize plaintext strings into critical tokens that can be later detokenized. Supports deterministic tokenization for consistent results.
Instructions
Tokenize plaintext values using ALTR critical tokenization.
Replaces plaintext strings with critical tokens
(format: token_XXXX..., 64+ chars). Tokens can be detokenized
later. Deterministic tokenization produces the same token for the
same input value.
Maximum 1024 values per call. Each value must be under 128 UTF-8 code units.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| values | Yes | Dict mapping user-defined keys to plaintext strings to tokenize (e.g. {"ssn": "123-45-6789", "email": "user@example.com"}). | |
| deterministic | No | If True, the same plaintext always produces the same token. Default False (random token each time). |
Output Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||