Scrapi MCP Server
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Scrapi MCP Serverconvert https://example.com to markdown"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
โก Fast & Reliable โ Built on 8+ years of web scraping expertise, 1,900+ production crawlers, and battle-tested anti-bot handling.
What is this?
An MCP (Model Context Protocol) server that lets AI agents fetch and read web pages. Simply give it a URL, and it returns clean, LLM-ready content โ fast.
Before: AI can't read web pages directly
After: "Summarize this article" just works โจ
Related MCP server: url-content-mcp
Features
๐ URL โ Markdown: Preserves headings, lists, links
๐ URL โ Text: Plain text extraction
๐ท๏ธ Metadata: Title, author, date, images
๐งน Clean Output: No ads, no navigation, no scripts
โก JavaScript Rendering: Works with SPAs
๐ณ Built-in Billing: Credit tracking, subscription management, usage analytics (MCP keys)
๐ Auto-Retry: 429 rate limit responses automatically retried with Retry-After
๐ Dual Transport: Stdio (npx) + Streamable HTTP for flexible deployment
Transport Modes
Scrapi MCP Server supports two transport modes:
Mode | Best For | Node.js Required |
Stdio | Claude Desktop, Cursor, Cline, Claude Code | Yes (auto via npx) |
Streamable HTTP | All clients, Node.js-free environments | No |
Prerequisites
Scrapi MCP account (separate from the main Scrapi account)
Claude Desktop, Cline, or Cursor installed
Node.js 20+
Installation
Option A: npx (Recommended)
No installation needed. Just configure your MCP client to use npx.
{
"mcpServers": {
"scrapi": {
"command": "npx",
"args": ["-y", "@scrapi.ai/mcp-server"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Tip: You can also pass the API key via CLI argument instead of env var:
"args": ["-y", "@scrapi.ai/mcp-server", "--api-key", "your-api-key"]
See Step 2 for where to put this configuration.
Option B: Install from Source
# Clone the repository
git clone https://github.com/bamchi/scrapi-mcp-server.git
cd scrapi-mcp-server
# Install dependencies and build
npm install && npm run buildStep 1: Get Your API Key
Go to https://scrapi.ai
Sign up or log in
Visit the MCP Dashboard โ your Free plan (500 credits/month) and API key are created automatically
Copy your
hsmcp_API key
Step 2: Configure MCP Server
Claude Desktop
Option A: Via Settings (Recommended)
Open Claude Desktop
Click Settings (gear icon, bottom left)
Select Developer tab
Click "Edit Config" button
Add the mcpServers configuration (see below)
Save and restart Claude Desktop (Cmd+Q, then reopen)
Option B: Edit config file directly
macOS:
~/Library/Application Support/Claude/claude_desktop_config.jsonWindows:
%APPDATA%\Claude\claude_desktop_config.json
Configuration (npx):
{
"mcpServers": {
"scrapi": {
"command": "npx",
"args": ["-y", "@scrapi.ai/mcp-server"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Configuration (from source):
{
"mcpServers": {
"scrapi": {
"command": "node",
"args": ["/absolute/path/to/scrapi-mcp-server/dist/index.js"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Note: Replace
/absolute/path/to/with the actual path where you cloned the repository.
Cline
Config file location:
macOS:
~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.jsonWindows:
%APPDATA%\Code\User\globalStorage\saoudrizwan.claude-dev\settings\cline_mcp_settings.json
Configuration (npx):
{
"mcpServers": {
"scrapi": {
"command": "npx",
"args": ["-y", "@scrapi.ai/mcp-server"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Configuration (from source):
{
"mcpServers": {
"scrapi": {
"command": "node",
"args": ["/absolute/path/to/scrapi-mcp-server/dist/index.js"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Cursor
Create or edit .cursor/mcp.json in your project root:
Configuration (npx):
{
"mcpServers": {
"scrapi": {
"command": "npx",
"args": ["-y", "@scrapi.ai/mcp-server"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Configuration (from source):
{
"mcpServers": {
"scrapi": {
"command": "node",
"args": ["/absolute/path/to/scrapi-mcp-server/dist/index.js"],
"env": {
"SCRAPI_API_KEY": "your-api-key"
}
}
}
}Claude Code
Option 1: CLI command (Recommended)
claude mcp add scrapi-ai -s user -e SCRAPI_API_KEY=your-api-key -- npx -y @scrapi.ai/mcp-serverOr with --api-key:
claude mcp add scrapi-ai -s user -- npx -y @scrapi.ai/mcp-server --api-key your-api-keyOption 2: Edit config file
Edit ~/.claude.json or project .mcp.json:
{
"mcpServers": {
"scrapi": {
"command": "npx",
"args": ["-y", "@scrapi.ai/mcp-server", "--api-key", "your-api-key"]
}
}
}Streamable HTTP
Connect via Streamable HTTP โ no Node.js installation needed on the client side.
Endpoint: https://scrapi.ai/mcp
Cursor (.cursor/mcp.json):
{
"mcpServers": {
"scrapi": {
"url": "https://scrapi.ai/mcp",
"headers": {
"Authorization": "Bearer your-api-key"
}
}
}
}Claude Code (CLI):
claude mcp add --transport http scrapi https://scrapi.ai/mcp \
--header "Authorization: Bearer your-api-key"Cline (cline_mcp_settings.json):
{
"mcpServers": {
"scrapi": {
"type": "streamableHttp",
"url": "https://scrapi.ai/mcp",
"headers": {
"Authorization": "Bearer your-api-key"
}
}
}
}Claude Desktop (claude_desktop_config.json):
{
"mcpServers": {
"scrapi": {
"command": "npx",
"args": [
"mcp-remote",
"https://scrapi.ai/mcp",
"--header",
"Authorization: Bearer your-api-key"
]
}
}
}Note: Claude Desktop requires the mcp-remote proxy for HTTP connections.
Run your own instance instead of using the hosted endpoint:
SCRAPI_API_KEY=your-api-key npx -y -p @scrapi.ai/mcp-server scrapi-http
# or from source:
SCRAPI_API_KEY=your-api-key node dist/http.jsThe server starts at http://localhost:3000 with the MCP endpoint at /mcp. Configure with PORT and HOST environment variables. Replace the URL in the client configurations above with your self-hosted URL (e.g. http://localhost:3000/mcp).
Health check: GET http://localhost:3000/health
Step 3: Restart Your AI Client
Claude Desktop: Fully quit (Cmd+Q on macOS, Alt+F4 on Windows) and reopen
Claude Code: Restart the session
Cline: Restart VS Code
Cursor: Restart the editor
You should see the MCP server connection indicator.
Available Tools
scrape_url
Scrapes a webpage and returns AI-readable content.
Parameters:
Name | Type | Required | Description |
| string | โ | URL to scrape |
| string |
|
Example:
{
"url": "https://example.com/article",
"format": "markdown"
}Markdown Output:
# Article Title
> Author: John Doe | Published: 2024-01-15
## Introduction
This is the main content of the article, converted to clean markdown...
## Key Points
- Point 1: Important detail
- Point 2: Another insight
- [Related Link](https://example.com/related)Text Output:
Article Title
Author: John Doe | Published: 2024-01-15
Introduction
This is the main content of the article, converted to plain text...
Key Points
- Point 1: Important detail
- Point 2: Another insightscrape_urls
Scrapes multiple webpages in parallel and returns AI-readable content.
Parameters:
Name | Type | Required | Description |
| string[] | โ | URLs to scrape (max 10) |
| string |
|
Example:
{
"urls": ["https://example.com/page1", "https://example.com/page2"],
"format": "text"
}Output:
[
{
"url": "https://example.com/page1",
"content": "Page 1 Title\n\nThis is the content of page 1..."
},
{
"url": "https://example.com/page2",
"content": "Page 2 Title\n\nThis is the content of page 2..."
}
]scraper_server_status
Check the status of all ScraperServer instances. Shows server health, circuit breaker state, failure counts, and timing info.
Parameters: None
Example:
{}Output:
## ScraperServer Status
Total: 3 | Available: 2
| Name | OS | Status | Failures | Last Success | Last Failure |
|------|----|--------|----------|--------------|--------------|
| pluto | linux | OK | 0 | 01/30 14:23:05 | - |
| mars | mac | FAIL | 2 | 01/29 10:00:00 | 01/30 13:55:12 |
| venus | linux | OPEN | 3 | 01/28 09:00:00 | 01/30 12:00:00 |
### Issues
- **mars**: Connection refused - connect(2)
- **venus**: Circuit breaker open until 01/30 12:30:00
- **venus**: Net::ReadTimeoutStatus values:
Status | Description |
| Server is healthy |
| Server is unhealthy |
| Circuit breaker open (isolated for 30 min) |
| Not yet checked |
get_usage
Check your API usage and remaining credits.
Parameters: None
Example:
{}Output:
## MCP Credits
| Item | Value |
|------|-------|
| Plan | starter |
| Subscription Credits | 1,500 |
| Purchased Credits | 200 |
| Total Remaining | 1,700 |
| Period End | 2026-03-01 |get_billing
Retrieve detailed billing information including subscription, plans, daily usage, and spending limits.
Parameters:
Name | Type | Required | Description |
| string | Yes |
|
| string | Start date for | |
| string | End date for |
Example โ Current subscription:
{ "action": "subscription" }## MCP Subscription
| Item | Value |
|------|-------|
| Plan | starter (Starter) |
| Status | active |
| Monthly Credits | 2,000 |
| Price | $19.00/mo |
| Rate Limit | 30 RPM |
| Burst Limit | 5 concurrent |
| Period End | 2026-03-01 |Example โ Available plans:
{ "action": "plans" }## Available MCP Plans
| Plan | Credits/mo | Price | RPM | Burst |
|------|-----------|-------|-----|-------|
| Free (free) | 500 | Free | 10 | 2 |
| Starter (starter) | 2,000 | $19.00/mo | 30 | 5 |
| Pro (pro) | 10,000 | $49.00/mo | 60 | 10 |
| Business (business) | 50,000 | $149.00/mo | 120 | 20 |Example โ Daily usage history:
{ "action": "daily_usage", "start_date": "2026-02-01", "end_date": "2026-02-07" }## Daily Usage (2026-02-01 ~ 2026-02-07)
| Date | Requests | Credits | Top Tool |
|------|----------|---------|----------|
| 2026-02-07 | 45 | 45 | scrape#scrape (45) |
| 2026-02-06 | 120 | 120 | scrape#scrape (100) |
**Total**: 165 requests, 165 creditsExample โ Spending limits:
{ "action": "spending_limits" }## Spending Limits
| Item | Value |
|------|-------|
| Daily Limit | 500 credits |
| Today's Usage | 120 credits |
| Usage % | 24.0% |Usage Examples
Example 1: Summarize a News Article
User: Summarize this article: https://news.example.com/article/12345
Claude: [calls scrape_url]
Here's a summary of the article:
## Key Points
- Point 1: ...
- Point 2: ...
- Point 3: ...Example 2: Fetch Page Content
User: Get the content from https://example.com/data
Claude: [calls scrape_url]
# Page Title
> Source: https://example.com/data
The page content is returned in clean Markdown format...Example 3: Research Competitor Pricing
User: What's the pricing on https://competitor.com/product/abc
Claude: [calls scrape_url]
Here's the pricing information:
- **Product**: ABC Premium
- **Regular Price**: $99.00
- **Sale Price**: $79.00 (20% off)Example 4: Read API Documentation
User: Read https://docs.example.com/api/v2 and write integration code
Claude: [calls scrape_url]
I've analyzed the API documentation. Here's the integration code:
// api-client.ts
export class ExampleApiClient {
private baseUrl = 'https://api.example.com/v2';
async getData(): Promise<Response> {
// ...
}
}How It Works
โโโโโโโโโโโโโโโโโโโ
โ User โ
โ "Summarize this โ
โ URL for me" โ
โโโโโโโโโโฌโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโ
โ Claude Desktop โ
โ / Cursor โ
โโโโโโโโโโฌโโโโโโโโโ
โ
โผ
โโโโโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโโโโ
โ MCP Server โโโโโโบโ Scrapi API โ
โ (scrape_url) โ โ (format param) โ
โโโโโโโโโโฌโโโโโโโโโ โโโโโโโโโโฌโโโโโโโโโ
โ โ
โโโโโโโโโโโโโโโโโโโโโโโโโ
โ Markdown/Text Response
โผ
โโโโโโโโโโโโโโโโโโโ
โ AI Response โ
โ (Summary, etc.) โ
โโโโโโโโโโโโโโโโโโโWhy Scrapi?
Built by the team behind Scrapi, with 8+ years of web scraping experience:
โ 1,900+ production crawlers
โ JavaScript rendering support
โ Anti-bot handling
โ 99.9% uptime
Troubleshooting
"API key is required"
Make sure your API key is provided via one of these methods:
Environment variable: Set
SCRAPI_API_KEYin your configurationCLI argument: Pass
--api-key your-keyin the args
"Invalid API key"
Verify that your API key is correct and active in your Scrapi dashboard.
npx using an old cached version
If you upgraded but still see old behavior, clear the npx cache:
npx clear-npx-cacheMCP Server not connecting
Ensure Node.js 20+ is installed
Try running
node /absolute/path/to/scrapi-mcp-server/dist/index.jsmanually to check for errorsFully quit Claude Desktop (Cmd+Q on macOS, Alt+F4 on Windows) and restart
Check Settings > Developer to verify the server is listed
Developer tab not visible
Update Claude Desktop to the latest version: Claude menu โ "Check for Updates..."
Support
Email: support@scrapi.ai
Issues: GitHub Issues
License
MIT ยฉ Scrapi
Available Tools
5 toolsget_billingAInspect
Retrieve MCP billing information: subscription details, available plans, daily usage history, or spending limits.
| Name | Required | Description | Default |
|---|---|---|---|
| action | Yes | What billing info to retrieve: subscription (current plan details), plans (available plans), daily_usage (credit usage history), spending_limits (daily spend limit status) | |
| start_date | No | Start date for daily_usage (YYYY-MM-DD). Default: 30 days ago | |
| end_date | No | End date for daily_usage (YYYY-MM-DD). Default: today |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the transparency burden. It conveys a read-only operation via 'Retrieve' but offers no additional behavioral detail such as authentication requirements, error behavior, or response format. While safe for a read tool, it adds minimal context beyond the obvious.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single sentence efficiently lists the tool's purpose and options. Every word earns its place, with clear enumeration of the retrievable billing categories. No wasted content.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's moderate complexity (3 params, 1 required, full schema descriptions) and no output schema, the description provides enough context: it names the four billing categories, and the schema fills in parameter details. It doesn't explain return structures, but for a simple retrieval tool this is sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the schema already documents all parameters and their enums. The description mentions categories like 'daily usage history' and 'spending limits' that map to action values, but it doesn't add new semantic meaning beyond what the schema already provides. Baseline 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses the specific verb 'Retrieve' and clearly identifies the resource as 'MCP billing information,' then enumerates distinct subtypes (subscription details, available plans, daily usage history, spending limits). This distinguishes it from sibling tools like get_usage by focusing on billing-specific categories.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for accessing billing data but provides no explicit guidance on when to choose this over get_usage or other siblings. It lacks exclusions or alternative tool references, relying on the term 'billing' to indicate context. This is implied usage rather than clear directive.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
get_usageAInspect
Check API usage and remaining credits. Returns current plan, subscription credits, purchased credits, and total remaining credits.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It explicitly enumerates the returned fields (current plan, subscription credits, purchased credits, total remaining credits), which is informative. It does not explicitly state read-only behavior or auth requirements, but for a zero-parameter query tool, the return specification is a strong behavioral disclosure.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two concise sentences, front-loaded with the primary purpose, and contains no filler or redundant information. It earns its place by stating both the action and the return details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the zero-parameter schema, no output schema, and no annotations, the description provides sufficient detail about the tool's behavior and return data. It is complete for an agent to understand what to expect. The only minor omission is an explicit read-only statement, but the nature of the tool makes it evident.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and the schema coverage is 100% (trivially, since there are no properties). The description adds meaning by explaining what the response contains, which is valuable for an agent deciding whether to call this tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function with a specific verb ('Check') and resource ('API usage and remaining credits'), and details the return content. It distinguishes itself from sibling tools like get_billing by focusing on credits versus billing information.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It provides clear context for when to use this tool (when you need to check API usage and remaining credits) and what it returns. It does not explicitly mention when not to use it or contrast with alternatives like get_billing, but the context is straightforward and not misleading.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
scraper_server_statusAInspect
Check the status of all ScraperServer instances. Shows server health, circuit breaker state, failure counts, and last success/failure times.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Since no annotations are provided, the description carries the burden of behavioral disclosure. It indicates this is a status check (likely read-only) and lists the data shown, which gives some behavioral insight. However, it does not mention any side effects, permissions, or output format details.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two concise sentences, front-loaded with the main purpose, and every word adds value. There is no redundancy or fluff.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (zero parameters, no output schema), the description adequately conveys what it does and what information it exposes. It lists the key data points (health, circuit breaker, failure counts, times) but could be slightly more explicit about the exact response structure. Still, it is largely complete for this simple tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the schema covers all parameter semantics (vacuously). The description adds no parameter details, but none are needed. Baseline 4 is appropriate for a zero-parameter tool.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states a specific verb ('check') and resource ('status of all ScraperServer instances'), and the details (health, circuit breaker, failure counts) distinguish it from sibling tools like get_billing and scrape_url. It fully identifies the tool's purpose.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It does not mention use cases, prerequisites, or when other tools might be more appropriate. This is a clear gap.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
scrape_urlAInspect
Scrapes a webpage and returns the content in AI-readable Markdown format. Can access blocked sites through browser rendering.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL of the webpage to scrape | |
| format | No | Output format: markdown (default) or text | markdown |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
There are no annotations, so the description must carry the full burden. It discloses that the tool uses browser rendering to access blocked sites, which is a useful behavioral detail. However, it doesn't mention potential limitations, rate limits, or error behavior, so transparency is incomplete.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences, with the primary purpose stated first and the key capability (browser rendering for blocked sites) as a secondary note. Every sentence is informative and there is no redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the core function and a differentiator, but it misses the distinction from scrape_urls, which could lead to agent confusion. Since there is no output schema, the description does mention the return format sufficiently. Overall, it's adequate but with clear gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema already provides descriptions for both parameters (url and format), and the context signal indicates 100% schema description coverage. The tool description doesn't add significant parameter-level meaning beyond what the schema already provides, so a baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it scrapes a webpage and returns content in Markdown format, which is specific and action-oriented. However, it doesn't differentiate from the sibling tool scrape_urls, which likely handles multiple URLs, so it falls short of a 5.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions the ability to access blocked sites through browser rendering, which gives some context for when this tool might be preferred. However, it doesn't explicitly state when to use this tool versus alternatives like scrape_urls, so the guidance is implied rather than explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
scrape_urlsAInspect
Scrapes multiple webpages in parallel and returns the content in AI-readable Markdown format. Can access blocked sites through browser rendering.
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | URLs to scrape (max 10) | |
| format | No | Output format: markdown (default) or text | markdown |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It discloses parallel processing and browser rendering for blocked sites, which are useful behavioral traits. However, it omits potential limitations such as rate limits, errors on inaccessible pages, or the size of returned content, leaving some operational expectations unspecified.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two efficient sentences with zero filler. The first sentence front-loads the action and purpose, while the second adds a distinctive capability. Every word contributes value.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a relatively simple tool with fully described parameters, the description adequately explains the tool's purpose, output format, and unique ability to handle blocked sites. It lacks only an explicit tie-in to the sibling tool 'scrape_url' and more detail on failure behavior, but these are minor gaps given the simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%; both 'urls' and 'format' have descriptions. The text's mention of 'multiple webpages' and 'Markdown format' aligns with these parameters but adds no new semantic detail beyond what the schema already provides. The baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description states a specific verb ('Scrapes'), a resource ('multiple webpages'), and a distinctive feature ('in parallel') that sets it apart from the sibling tool 'scrape_url' which likely handles single URLs. It also clarifies the output format ('AI-readable Markdown') and a key capability ('access blocked sites through browser rendering').
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage for multiple URLs and for sites that may be blocked, but it does not explicitly mention when to avoid using this tool or point to alternatives like 'scrape_url' for single pages. While context is clear, no direct comparison or exclusions are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
5 tool updates
v3.2.0- First observed
get_billing - First observed
get_usage - First observed
scrape_url - First observed
scrape_urls - First observed
scraper_server_status
TDQS
Scored across 5 tools
Each tool has a distinct purpose: billing info, usage credits, server status, single scrape, and batch scrape. The two billing/usage tools are related but their descriptions clearly differentiate scope, so an agent can distinguish them.
Most tools follow verb_noun pattern (e.g., get_billing, scrape_url), but 'scraper_server_status' uses a noun phrase without a clear verb, introducing inconsistency. The naming is readable but not fully uniform.
With 5 tools, the set is well-scoped for the server's purpose: core scraping functionality (single and batch), server monitoring, and account/usage management. Each tool is necessary and none are redundant.
The tool set covers essential actions like scraping and checking status/billing, but lacks management operations such as stopping a scrape, updating billing plans, or configuring scrape options. This creates notable gaps that agents may need to work around.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
MCP server (stdio): fetch web pages as clean readable markdown via the AgentForge API
Scrape, crawl and search the web for AI agents via MCP.
Document-to-Markdown MCP server โ convert PDF, Office and HTML into LLM-ready Markdown.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceMCP server that allows AI agents to fetch and process llms.txt documentation from various sources. Fetch documentation from any HTTPS URL and automatically convert HTML content to readable markdown.72MIT
- AlicenseNot gradedqualityDmaintenanceMCP server that fetches raw HTML content from a given URL to provide web context to LLMs.1-
- AlicenseAqualityCmaintenanceMCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.2MIT
- FlicenseAqualityDmaintenanceMCP server for Cloudflare Browser Rendering Crawl API. Fetches and crawls web pages, returning clean Markdown optimized for LLM consumption.3-