generate_config
Create JSON configuration files for scraping documentation websites to extract structured data for AI training and RAG knowledge bases.
Instructions
Generate a config file for documentation scraping. Interactively creates a JSON config for any documentation website.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| name | Yes | ||
| url | Yes | ||
| description | Yes | ||
| max_pages | No | ||
| unlimited | No | ||
| rate_limit | No |