split_chunks
Split text into chunks of at most N tokens (cl100k_base: ~4 chars/token) with optional overlap. Designed for RAG ingestion pipelines.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| input | Yes | Text to split into chunks | |
| overlap | No | Token overlap between consecutive chunks (default: 0) | |
| chunk_tokens | Yes | Maximum tokens per chunk (10–8000) |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| chunks | No | ||
| chunk_count | No | ||
| overlap_tokens | No | ||
| tokens_per_chunk | No |