sent_split
Split text into sentences with exact character offsets for RAG chunking and citation-grade spans, using spaCy, regex, or Chinese jieba segmentation by language.
Instructions
Sentence segmentation with offsets - the foundation for RAG chunking.
Chinese: jieba + rule regex; English: spaCy sents by default, or the
zero-dependency regex fallback with engine="regex" - use the fast
path for bulk preprocessing where neural segmentation is not worth the
CPU time.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| lang | No | auto | |
| text | Yes | ||
| engine | No | auto |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||