-
securityA
license-
qualityA Model Context Protocol server that allows LLMs to interact with web content through standardized tools, currently supporting web scraping functionality.
Last updated -
1
MIT License
ScrapeGraph MCP Server
A production-ready Model Context Protocol (MCP) server that provides seamless integration with the ScapeGraph AI API. This server enables language models to leverage advanced AI-powered web scraping capabilities with enterprise-grade reliability.
Available Tools
The server provides the following enterprise-ready tools:
markdownify(website_url: str): Transform any webpage into clean, structured markdown formatsmartscraper(user_prompt: str, website_url: str): Leverage AI to extract structured data from any webpagesearchscraper(user_prompt: str): Execute AI-powered web searches with structured, actionable results
Setup Instructions
To utilize this server, you'll need a ScapeGraph API key. Follow these steps to obtain one:
- Navigate to the ScapeGraph Dashboard
- Create an account and generate your API key
Automated Installation via Smithery
For automated installation of the ScrapeGraph API Integration Server using Smithery:
Claude Desktop Configuration
Update your Claude Desktop configuration file with the following settings (located on the top rigth of the Cursor page):
(remember to add your API key inside the config)
The configuration file is located at:
- Windows:
%APPDATA%/Claude/claude_desktop_config.json - macOS:
~/Library/Application\ Support/Claude/claude_desktop_config.json
Cursor Integration
Add the ScrapeGraphAI MCP server on the settings:
Example Use Cases
The server enables sophisticated queries such as:
- "Analyze and extract the main features of the ScapeGraph API"
- "Generate a structured markdown version of the ScapeGraph homepage"
- "Extract and analyze pricing information from the ScapeGraph website"
- "Research and summarize recent developments in AI-powered web scraping"
- "Create a comprehensive summary of the Python documentation website"
Error Handling
The server implements robust error handling with detailed, actionable error messages for:
- API authentication issues
- Malformed URL structures
- Network connectivity failures
- Rate limiting and quota management
Common Issues
Windows-Specific Connection
When running on Windows systems, you may need to use the following command to connect to the MCP server:
This ensures proper execution in the Windows environment.
License
This project is distributed under the MIT License. For detailed terms and conditions, please refer to the LICENSE file.
Acknowledgments
Special thanks to tomekkorbak for his implementation of oura-mcp-server, which served as starting point for this repo.
Made with ❤️ by ScrapeGraphAI Team
remote-capable server
The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.
언어 모델이 AI 기반 웹 스크래핑 기능을 활용할 수 있도록 하는 프로덕션에 바로 사용 가능한 모델 컨텍스트 프로토콜 서버로, 웹페이지를 마크다운으로 변환하고, 구조화된 데이터를 추출하고, AI 기반 웹 검색을 실행하는 도구를 제공합니다.
Related Resources
Related MCP Servers
- AsecurityAlicenseAqualityA Model Context Protocol server enabling AI assistants to scrape web content with high accuracy and flexibility, supporting multiple scraping modes and content formatting options.Last updated -4522MIT License
- -securityFlicense-qualityHigh-performance server enabling AI assistants to access web scraping, crawling, and deep research capabilities through Model Context Protocol.Last updated -13
- -securityFlicense-qualityA Model Context Protocol server that collects, analyzes, and manages AI use case data from various information sources with features for web scraping, data analysis, and trend identification.Last updated -