Skip to main content
Glama

web-scraping-mcp-server

Server Details

Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.

Status
Healthy
Last Tested
Transport
Streamable HTTP
URL

Glama MCP Gateway

Connect through Glama MCP Gateway for full control over tool access and complete visibility into every call.

MCP client
Glama
MCP server

Full call logging

Every tool call is logged with complete inputs and outputs, so you can debug issues and audit what your agents are doing.

Tool access control

Enable or disable individual tools per connector, so you decide what your agents can and cannot do.

Managed credentials

Glama handles OAuth flows, token storage, and automatic rotation, so credentials never expire on your clients.

Usage analytics

See which tools your agents call, how often, and when, so you can understand usage patterns and catch anomalies.

100% free. Your data is private.
Tool DescriptionsA

Average 3.9/5 across 3 of 3 tools scored.

Server CoherenceA
Disambiguation5/5

Each tool targets a distinct source: crawling any website, searching Google, and looking up Wikipedia articles. No overlapping purposes.

Naming Consistency5/5

All three tools follow a clear verb_noun pattern: crawl_website, google_search, wikipedia_lookup. Consistent and predictable.

Tool Count4/5

Three tools is minimal but reasonable for a focused web scraping server. Each tool serves a distinct purpose, though additional tools (e.g., single-page scrape) could be expected.

Completeness3/5

Notable gaps: missing a general single-page fetch or extract tool. While crawl_website handles multi-page crawling, there is no way to scrape a single page without crawling links.

Available Tools

3 tools
crawl_websiteB
Read-only
Inspect

Crawl a website and extract its content as structured data.

Args: url: Website URL to crawl (e.g. 'https://example.com') max_pages: Max pages to crawl (default 5)

ParametersJSON Schema
NameRequiredDescriptionDefault
urlYes
max_pagesNo
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already provide readOnlyHint=true and openWorldHint=true. The description adds that it extracts content as structured data, but does not disclose potential behavioral traits like rate limits, handling of dynamic content, or what constitutes 'structured data.' It adds minimal value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is concise with a clear title and structured Args block. It has no wasted words, though it could potentially be even shorter by integrating the parameter info into the main sentence. Still, it is well-organized.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with annotations, the description covers purpose and parameters. However, it lacks details on return format or behavior (e.g., what 'structured data' means). Despite no output schema, the description could better set expectations. It is adequate but not thorough.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The description includes an Args section explaining both parameters (url: URL to crawl, max_pages: max pages with default 5) with examples. This adds meaning beyond the input schema, which only defines types and defaults. Given schema coverage is 0%, the description compensates well.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action: 'Crawl a website and extract its content as structured data.' It specifies the verb (crawl) and resource (website), and the outcome. This distinctively separates it from sibling tools like google_search and wikipedia_lookup.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus siblings or when not to use it. There is no mention of prerequisites, ethical considerations, or alternatives. The agent has to infer from context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

wikipedia_lookupA
Read-only
Inspect

Look up a Wikipedia article and return its content.

Args: topic: Topic to look up (e.g. 'Artificial intelligence')

ParametersJSON Schema
NameRequiredDescriptionDefault
topicYes
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=true, covering safety and openness. The description adds that it returns content but lacks details on behavior like rate limits, response format, or any side effects, so it adds limited value beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is extremely concise: two sentences plus an Args line. It front-loads the purpose in the first sentence, and every part is necessary and sufficient. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite no output schema, the description adequately notes that it 'return[s] its content'. For a simple read-only tool with one parameter, this is mostly complete. However, it could briefly mention the format (plain text, sections) or potential limitations (article size).

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 0% schema description coverage, the description fully compensates by explaining the single 'topic' parameter with a clear example ('e.g. 'Artificial intelligence''), adding meaning beyond the schema's type-only definition.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 'Look up' and resource 'Wikipedia article', clearly indicating the tool's function. It effectively distinguishes from siblings like 'google_search' (general search) and 'crawl_website' (generic crawling) by specifying its Wikipedia focus.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for retrieving Wikipedia content, providing clear context. However, it does not explicitly state when to use this tool versus alternatives like google_search or crawl_website, missing an opportunity for clearer guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Discussions

No comments yet. Be the first to start the discussion!

Try in Browser

Your Connectors

Sign in to create a connector for this server.

Resources