Glama
Sign In

ScrapeGraph MCP Server

Official
by ScrapeGraphAI
GitHub
Python
MIT License
5
  • Apple
RedditDiscord
OverviewInspectSchemaRelated ServersReviewsScore
Need Help?View Source CodeReport Issue

remote-capable server

The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.

Integrations

  • Provides tools to convert any webpage into clean, structured markdown format through the markdownify function

  • Supports Python 3.10 for the implementation of the server that integrates with ScapeGraph AI

ScrapeGraph MCP Server

A production-ready Model Context Protocol (MCP) server that provides seamless integration with the ScapeGraph AI API. This server enables language models to leverage advanced AI-powered web scraping capabilities with enterprise-grade reliability.

Available Tools

The server provides the following enterprise-ready tools:

  • markdownify(website_url: str): Transform any webpage into clean, structured markdown format
  • smartscraper(user_prompt: str, website_url: str): Leverage AI to extract structured data from any webpage
  • searchscraper(user_prompt: str): Execute AI-powered web searches with structured, actionable results

Setup Instructions

To utilize this server, you'll need a ScapeGraph API key. Follow these steps to obtain one:

  1. Navigate to the ScapeGraph Dashboard
  2. Create an account and generate your API key

Automated Installation via Smithery

For automated installation of the ScrapeGraph API Integration Server using Smithery:

npx -y @smithery/cli install @ScrapeGraphAI/scrapegraph-mcp --client claude

Claude Desktop Configuration

Update your Claude Desktop configuration file with the following settings (located on the top rigth of the Cursor page):

(remember to add your API key inside the config)

{ "mcpServers": { "@ScrapeGraphAI-scrapegraph-mcp": { "command": "npx", "args": [ "-y", "@smithery/cli@latest", "run", "@ScrapeGraphAI/scrapegraph-mcp", "--config", "\"{\\\"scrapegraphApiKey\\\":\\\"YOUR-SGAI-API-KEY\\\"}\"" ] } } }

The configuration file is located at:

  • Windows: %APPDATA%/Claude/claude_desktop_config.json
  • macOS: ~/Library/Application\ Support/Claude/claude_desktop_config.json

Cursor Integration

Add the ScrapeGraphAI MCP server on the settings:

Example Use Cases

The server enables sophisticated queries such as:

  • "Analyze and extract the main features of the ScapeGraph API"
  • "Generate a structured markdown version of the ScapeGraph homepage"
  • "Extract and analyze pricing information from the ScapeGraph website"
  • "Research and summarize recent developments in AI-powered web scraping"
  • "Create a comprehensive summary of the Python documentation website"

Error Handling

The server implements robust error handling with detailed, actionable error messages for:

  • API authentication issues
  • Malformed URL structures
  • Network connectivity failures
  • Rate limiting and quota management

Common Issues

Windows-Specific Connection

When running on Windows systems, you may need to use the following command to connect to the MCP server:

C:\Windows\System32\cmd.exe /c npx -y @smithery/cli@latest run @ScrapeGraphAI/scrapegraph-mcp --config "{\"scrapegraphApiKey\":\"YOUR-SGAI-API-KEY\"}"

This ensures proper execution in the Windows environment.

License

This project is distributed under the MIT License. For detailed terms and conditions, please refer to the LICENSE file.

Acknowledgments

Special thanks to tomekkorbak for his implementation of oura-mcp-server, which served as starting point for this repo.

Made with ❤️ by ScrapeGraphAI Team

You must be authenticated.

A
security – no known vulnerabilities
A
license - permissive license
A
quality - confirmed to work

A production-ready Model Context Protocol server that enables language models to leverage AI-powered web scraping capabilities, offering tools for transforming webpages to markdown, extracting structured data, and executing AI-powered web searches.

  1. Available Tools
    1. Setup Instructions
      1. Automated Installation via Smithery
        1. Claude Desktop Configuration
          1. Cursor Integration
          2. Example Use Cases
            1. Error Handling
              1. Common Issues
                1. Windows-Specific Connection
                2. License
                  1. Acknowledgments

                    Related Resources