Chunk web page for RAG
chunk_urlFetch a web page and split its main content into heading-aware, token-bounded chunks for RAG and embeddings. Each chunk includes its heading path and token count.
Instructions
Fetch a web page and split its main content into heading-aware, token-bounded chunks for RAG/embeddings. Each chunk has its heading path and token count.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute http(s) URL, at most 2048 characters. | |
| max_tokens | No | Maximum tokens per chunk, 64-8192. Default 512. | |
| include_links | No | Keep links as [text](url). Default true. | |
| include_images | No | Keep images as . Default false. | |
| include_tables | No | Keep tables as Markdown tables. Default true. | |
| overlap_tokens | No | Tokens of overlap between chunks, 0-1024. Default 50. |