optimize_rag_chunks
Split large Markdown or text into header-aware semantic chunks with token counts and section headers for efficient LLM embeddings and context management.
Instructions
Semantic RAG Chunker & Token Optimizer: Splits large scraped web documents into header-aware semantic chunks with token counts and section headers for LLM embeddings and context efficiency.
Args: text_or_markdown: The large Markdown or text string to chunk. max_chunk_chars: Maximum characters per chunk (default 2000 ~500 tokens).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| max_chunk_chars | No | ||
| text_or_markdown | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |