Skip to main content
Glama
Neuratel-AI

Neuratel MCP Server

Official
by Neuratel-AI

add_knowledge_from_url

Scrape a public URL to create a searchable knowledge base. Extracts content from web pages (including JavaScript-rendered), chunks it, and indexes for RAG.

Instructions

Create a knowledge base by scraping and indexing a web page.

Fetches the URL, extracts the content (handles JavaScript-rendered pages), converts to clean text, chunks it, and indexes for RAG. Processing happens asynchronously — check the status field.

Best for: product documentation, help center articles, pricing pages, company info, or any publicly accessible web content.

The URL must be publicly accessible. Status will be "processing" initially, then "ready" when indexing completes (usually <30 seconds), or "error" if the page couldn't be fetched.

Args: name: Display name (e.g. "Product Documentation", "Pricing Page") url: Public URL to scrape (https://docs.example.com/faq) description: What this knowledge covers

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYes
nameYes
descriptionNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of behavioral disclosure. It excels by explaining that processing is asynchronous, how to check status, the expected status transitions (processing → ready/error), typical duration (<30 seconds), and failure conditions. It also reveals that JavaScript-rendered pages are handled. This is exemplary transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-structured, front-loaded with a clear one-sentence summary, followed by the process, use cases, constraints, status information, and parameter details. Every sentence adds value without redundancy, making it appropriately sized for the complexity of the tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given that the tool involves async scraping and indexing, the description is remarkably complete. It covers purpose, workflow, usage scenarios, constraints, status lifecycle, error states, and parameter meanings. An output schema exists, so return values need not be described, but the description still provides sufficient context for an agent to select and invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0%, yet the description includes an 'Args' section with meaningful explanations for each parameter: name (with examples), url (with example URL and requirement), and description (what it covers). This fully compensates for the sparse schema and adds practical guidance beyond type definitions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Create a knowledge base by scraping and indexing a web page.' It specifies the resource (knowledge base), the method (scraping and indexing a URL), and even describes the pipeline (fetch, extract, convert, chunk, index). This distinguishes it from sibling tools like add_knowledge_from_text, which likely handles raw text input.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides clear context on when to use: 'Best for: product documentation, help center articles, pricing pages, company info, or any publicly accessible web content.' It also states the URL must be publicly accessible. However, it does not explicitly mention when not to use or direct users to an alternative like add_knowledge_from_text, so it falls just short of full alternative guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Neuratel-AI/neuratel-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server