RAG Dataset Builder
sitemap-to-knowledgeGive it a domain. It reads the sitemap, fetches the pages, strips them to clean text and splits everything into ~1000-char chunks — one dataset row per chunk, ready to embed into a vector store. No browser, no LLM, no API key. — $0.02/call, x402 (USDC on base).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"items": "<items>"
},
"name": "sitemap-to-knowledge"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| items | Yes | List of domains or website URLs to crawl via their sitemap. One entry per site. | |
| maxConcurrency | No | How many SITES to process in parallel (each site already fetches up to 25 pages internally). |