add_knowledge_from_url
Scrape a public URL to create a searchable knowledge base. Extracts content from web pages (including JavaScript-rendered), chunks it, and indexes for RAG.
Instructions
Create a knowledge base by scraping and indexing a web page.
Fetches the URL, extracts the content (handles JavaScript-rendered pages), converts to clean text, chunks it, and indexes for RAG. Processing happens asynchronously — check the status field.
Best for: product documentation, help center articles, pricing pages, company info, or any publicly accessible web content.
The URL must be publicly accessible. Status will be "processing" initially, then "ready" when indexing completes (usually <30 seconds), or "error" if the page couldn't be fetched.
Args: name: Display name (e.g. "Product Documentation", "Pricing Page") url: Public URL to scrape (https://docs.example.com/faq) description: What this knowledge covers
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| name | Yes | ||
| description | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||