text_chunk
Split text or Markdown into RAG-ready chunks using token-based sizing, heading-aware boundaries, and optional overlap. Prepares content for vector database embedding.
Instructions
Split text or Markdown into RAG-ready chunks: token-based sizing, heading-aware boundaries, optional overlap, heading path and page metadata per chunk. The standard preprocessing step before embedding into a vector DB. $0.01.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | Text or Markdown to chunk | |
| overlap | No | ||
| split_on | No | heading | |
| max_tokens | No | ||
| idempotency_key | No |