tealkit_crawl_and_index
Recursively crawl website documentation and index pages into a local offline RAG knowledge base for retrieval. Set a root URL and page limit to build searchable offline docs.
Instructions
Recursively crawls a website documentation tree (up to max_pages) and indexes it into the local offline RAG knowledge base.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Root URL to start recursive crawling (e.g. https://docs.flutter.dev) | |
| max_pages | No | Maximum number of pages to crawl (default: 30, max: 200) |