UseScraper MCP Server

This is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.

Features

Tools

scrape - Extract content from a webpage
- Parameters:
  - url (required): The URL of the webpage to scrape
  - format (optional): The format to save the content (text, html, markdown). Default: markdown
  - advanced_proxy (optional): Use advanced proxy to circumvent bot detection. Default: false
  - extract_object (optional): Object specifying data to extract

Installation

Installing via Smithery

To install UseScraper for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install usescraper-server --client claude

Manual Installation

Clone the repository:
git clone https://github.com/your-repo/usescraper-server.git cd usescraper-server
Install dependencies:
npm install
Build the server:
npm run build

Configuration

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "usescraper-server": {
      "command": "node",
      "args": ["/path/to/usescraper-server/build/index.js"],
      "env": {
        "USESCRAPER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Replace /path/to/usescraper-server with the actual path to the server and your-api-key-here with your UseScraper API key.

Usage

Once configured, you can use the 'scrape' tool through the MCP interface. Example usage:

{
  "name": "scrape",
  "arguments": {
    "url": "https://example.com",
    "format": "markdown"
  }
}

Development

For development with auto-rebuild:

npm run watch

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

npm run inspector

The Inspector will provide a URL to access debugging tools in your browser.

Deploy Server

HTTP connection URL

security – no known vulnerabilities

license - permissive license

quality - confirmed to work

How are these scores calculated?

remote-capable server

The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.

Tools

scrape

A TypeScript-based MCP server utilizing the UseScraper API to provide web scraping capabilities, allowing users to extract content from webpages in various formats.

Related Resources

Reddit Discussion about this server

Related MCP Servers

Scrapezyofficial
Scrapezy
A
security
A
license
A
quality
MCP Server enabling integration with Scrapezy to retrieve structured data from websites.
Last updated -
1
297
7
MIT License
MD Webcrawl MCP
jmh108
-
security
A
license
-
quality
A Python-based MCP server that crawls websites to extract and save content as markdown files, with features for mapping website structure and links.
Last updated -
3
MIT License
Web Scraper MCP Server
naku111
A
security
A
license
A
quality
A TypeScript-based web scraping server built on the Model Context Protocol that offers multiple export formats, content extraction rules, and support for both static and dynamic (SPA) websites.
Last updated -
7
258
MIT License
MCP Server for Crawl4AI
omgwtfwow
-
security
A
license
-
quality
TypeScript implementation of an MCP server that provides tools for web crawling, content extraction, and browser automation, enabling AI systems to access and process web content through 15 specialized tools.
Last updated -
255
6
MIT License

View all related MCP servers

UseScraper MCP Server