UseScraper MCP Server
The UseScraper MCP Server enables web scraping with customizable extraction options:
Scrape webpage content: Extract content from any webpage by providing its URL
Choose output format: Save scraped content as text, HTML, or markdown (default is markdown)
Bypass restrictions: Use advanced proxy to circumvent bot detection
Custom extraction: Specify specific data to extract using the extract_object parameter
AI-optimized: Default markdown format ensures optimal processing for AI systems
Allows scraping web content and converting it to Markdown format.
The MCP server is built using TypeScript.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@UseScraper MCP Serverscrape the latest news from BBC homepage as markdown"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
UseScraper MCP Server
This is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.
Features
Tools
scrape- Extract content from a webpageParameters:
url(required): The URL of the webpage to scrapeformat(optional): The format to save the content (text, html, markdown). Default: markdownadvanced_proxy(optional): Use advanced proxy to circumvent bot detection. Default: falseextract_object(optional): Object specifying data to extract
Related MCP server: MCP-Typescribe
Installation
Installing via Smithery
To install UseScraper for Claude Desktop automatically via Smithery:
npx -y @smithery/cli install usescraper-server --client claudeManual Installation
Clone the repository:
git clone https://github.com/your-repo/usescraper-server.git cd usescraper-serverInstall dependencies:
npm installBuild the server:
npm run build
Configuration
To use with Claude Desktop, add the server config:
On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json
On Windows: %APPDATA%/Claude/claude_desktop_config.json
{
"mcpServers": {
"usescraper-server": {
"command": "node",
"args": ["/path/to/usescraper-server/build/index.js"],
"env": {
"USESCRAPER_API_KEY": "your-api-key-here"
}
}
}
}Replace /path/to/usescraper-server with the actual path to the server and your-api-key-here with your UseScraper API key.
Usage
Once configured, you can use the 'scrape' tool through the MCP interface. Example usage:
{
"name": "scrape",
"arguments": {
"url": "https://example.com",
"format": "markdown"
}
}Development
For development with auto-rebuild:
npm run watchDebugging
Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:
npm run inspectorThe Inspector will provide a URL to access debugging tools in your browser.
Available Tools
1 toolscrapeC
Scrape content from a webpage using UseScraper API
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to scrape | |
| format | No | Format to save crawled page content. Strongly recommended to keep as markdown for optimal AI processing (default: markdown) | |
| advanced_proxy | No | Use advanced proxy to circumvent bot detection (default: false) | |
| extract_object | No | Optional object specifying data to extract |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description fails to disclose behavioral traits beyond the API name. It does not mention rate limits, authentication, potential failures, or what happens with the proxy option. The schema provides some param hints, but the description adds no behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, concise and front-loaded. It is appropriately sized for a simple tool, though it could include a bit more detail without becoming verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 4 parameters, nested objects, and no output schema, the description is too minimal. It does not explain what is returned or how the tool behaves in edge cases, leaving significant gaps for an agent.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with each parameter described, so the baseline is 3. The description adds minimal extra meaning beyond stating the API, so it meets the baseline without enhancing understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description identifies the action (scrape) and resource (webpage), naming the API used (UseScraper). However, 'scrape' is broad and could be more specific about what types of content or how it extracts, but without siblings it's sufficiently clear.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives or any exclusions. The description only states what it does, leaving the agent to infer usage context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
TDQS
Only one tool exists, so there is no possibility of confusion with other tools.
With a single tool, naming is trivially consistent.
A single tool for web scraping is borderline; it might suffice for basic use but feels thin for a full-featured scraper server.
The single scrape tool covers the core functionality, but lacks additional features like selecting specific elements or handling different output formats, which are common in web scraping APIs.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
A TypeScript MCP server for Home Assistant, enabling programmatic management of entities, automati…
A simple Typescript MCP server built using the official MCP Typescript SDK and smithery/cli. This…
All HasData scraping tools in one MCP server: Google, TikTok, Instagram, maps, e-commerce and more.
One MCP server for 180+ live web-data APIs returning clean JSON from sites that block scrapers.
Related MCP Servers
- AlicenseCqualityCmaintenanceMCP Server enabling integration with Scrapezy to retrieve structured data from websites.12513MIT
- AlicenseNot gradedqualityDmaintenanceAn MCP server that enables LLMs to understand and work with TypeScript APIs they haven't been trained on by providing structured access to TypeScript type definitions and documentation.3046MIT
- AlicenseAqualityDmaintenanceA TypeScript-based web scraping server built on the Model Context Protocol that offers multiple export formats, content extraction rules, and support for both static and dynamic (SPA) websites.7121MIT
- AlicenseNot gradedqualityDmaintenanceA TypeScript-based MCP server that provides backend API handling and facilitates communication between microservices. Features an organized structure with controllers, routes, and models for easy extensibility and maintenance.2251MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/tanevanwifferen/usescraper-mcp-server'
If you have feedback or need assistance with the MCP directory API, please join our Discord server