UseScraper MCP Server

This is a TypeScript-based MCP server that provides web scraping capabilities using the UseScraper API. It exposes a single tool 'scrape' that can extract content from web pages in various formats.

Features

Tools

• scrape - Extract content from a webpage

  • Parameters:

    • url (required): The URL of the webpage to scrape

    • format (optional): The format to save the content (text, html, markdown). Default: markdown

    • advanced_proxy (optional): Use advanced proxy to circumvent bot detection. Default: false

    • extract_object (optional): Object specifying data to extract

Related MCP server: MD Webcrawl MCP

Installation

Installing via Smithery

To install UseScraper for Claude Desktop automatically via Smithery:

Manual Installation

1. Clone the repository:

   git clone https://github.com/your-repo/usescraper-server.git cd usescraper-server

2. Install dependencies:

   npm install

3. Build the server:

   npm run build

Configuration

To use with Claude Desktop, add the server config:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

Replace /path/to/usescraper-server with the actual path to the server and your-api-key-here with your UseScraper API key.

Usage

Once configured, you can use the 'scrape' tool through the MCP interface. Example usage:

Development

For development with auto-rebuild:

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

The Inspector will provide a URL to access debugging tools in your browser.