UseScraper MCP Server

UseScraper MCP Server

This is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.

Features

Tools

• scrape - Extract content from a webpage
  • Parameters:
    • url (required): The URL of the webpage to scrape
    • format (optional): The format to save the content (text, html, markdown). Default: markdown
    • advanced_proxy (optional): Use advanced proxy to circumvent bot detection. Default: false
    • extract_object (optional): Object specifying data to extract

Installation

Installing via Smithery

To install UseScraper for Claude Desktop automatically via Smithery:

Manual Installation

1. Clone the repository:
   git clone https://github.com/your-repo/usescraper-server.git cd usescraper-server
2. Install dependencies:
   npm install
3. Build the server:
   npm run build

Configuration

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

Replace /path/to/usescraper-server with the actual path to the server and your-api-key-here with your UseScraper API key.

Usage

Once configured, you can use the 'scrape' tool through the MCP interface. Example usage:

Development

For development with auto-rebuild:

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

The Inspector will provide a URL to access debugging tools in your browser.