tokenize
Convert Pylpex source code into tokens for analysis, providing token types, values, and positions to support code examination and debugging.
Instructions
Convert Pylpex code into tokens for analysis.
Args: code: Valid Pylpex source code to tokenize
Returns: List of tokens with their types, values, and positions
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| code | Yes |