🌐 Anysite MCP Server

Agent-First Web Scraping Infrastructure via Model Context Protocol

Connect your AI agents to real-time data from LinkedIn, Instagram, Reddit, Twitter, and any website through a single MCP server.

🚀 Quick Start • 📖 Documentation • 🐦 Twitter

💎 MCP Unlimited Plan

Unlimited access to all 65+ Anysite MCP tools for just $30/month - perfect for AI agents and automation.

Get unlimited requests through Remote MCP Server with no request limits. Ideal for Claude Desktop, Cursor, n8n, and any MCP-compatible client.

📖 Learn more about MCP Unlimited →

Available integrations:

• Make.com Integration - Connect with Make.com workflows

• Clay Integration - Use with Clay enrichment platform

Related MCP server: Proxycurl MCP Server

🎯 What is Anysite MCP Server?

Anysite MCP Server is a Model Context Protocol (MCP) implementation that gives AI agents direct access to web data through platform-specific APIs. Unlike traditional web scrapers, Anysite provides:

• 🔒 OAuth Authentication - Secure, one-click connection for Claude Desktop and other MCP clients

• 🌐 Multi-Platform Support - LinkedIn, Instagram, Reddit, Twitter, and custom web parsing

• 🤖 Agent-First Design - Built specifically for AI agents with structured data formats

• 🔄 Self-Healing APIs - Auto-recovery from platform changes and rate limits

• ⚡ Real-Time Data - Fresh data extraction without stale caches

Perfect for: AI research, lead generation, market intelligence, content monitoring, competitive analysis

⚡ Key Features

🎪 Supported Platforms

🛠️ Core Capabilities

• Advanced Search & Filtering - Find people by title, company, location, education, skills

• Bulk Data Extraction - Extract thousands of profiles, posts, or comments in one request

• Network Analysis - Map connections, followers, engagement patterns

• Content Monitoring - Track posts, comments, reactions in real-time

• Account Management - Send messages, connection requests, post comments (LinkedIn)

• Smart Web Parsing - Extract structured data from any website using CSS selectors

🔐 Enterprise-Grade Features

• Rate Limit Management - Automatic backoff and retry with exponential delays

• Proxy Rotation - Built-in proxy support for high-volume requests

• Error Recovery - Self-healing mechanisms for platform changes

• Usage Analytics - Track API consumption and costs

• Team Management - Multi-user accounts with role-based access

🚀 Quick Start

Option 1: Remote MCP with OAuth (Recommended)

Perfect for Claude Desktop, Cline, Cursor, Windsurf, and other MCP clients that support OAuth.

Step 1: Get Your OAuth URL

1. Sign up at app.anysite.io (100 free credits included)

2. Navigate to MCP Server Integration

3. Copy your OAuth URL: https://mcp.anysite.io/

Step 2: Add to Your MCP Client

1. Open Claude Desktop → Settings → Connectors

2. Click Add Custom Connector

3. Fill in:

   • Name: Anysite MCP

   • OAuth URL: https://mcp.anysite.io/

4. Click Add → Connect → Allow Access

📖 Detailed Claude Desktop Setup Guide

Add to your MCP configuration file:

Configuration file locations:

• Cline: .cline/mcp_settings.json

• Cursor: .cursor/mcp_config.json

• Windsurf: .windsurf/mcp_config.json

Step 3: Verify Connection

Ask your AI agent:

Expected response should include:

• search_linkedin_users

• get_linkedin_profile

• get_instagram_user

• search_reddit_posts

• duckduckgo_search

• search_youtube_videos

• parse_webpage

• ... and 65+ more tools

Option 2: Local MCP Server (For Development)

Perfect for testing, development, custom integrations.

Installation

Configuration

Create .env file:

Get your credentials from app.anysite.io

Run Server

Connect to MCP Client

Add to your MCP configuration:

🎮 Usage Examples

LinkedIn: Find Decision Makers

The MCP server will:

1. Search LinkedIn users with title="CTO", company_keywords="AI", location="San Francisco"

2. Return structured profiles with name, headline, company, location

3. Provide direct LinkedIn URLs for each profile

Instagram: Monitor Brand Mentions

Reddit: Analyze Discussions

Multi-Platform Research

📖 Documentation

📚 Full Documentation

• Anysite MCP Server Docs

• API Reference

• All Available Tools

🔧 Tool Categories (65+ Total)

• duckduckgo_search - Web search powered by DuckDuckGo (up to 20 results)

• get_yc_company - Get comprehensive YC company information by slug

• search_yc_companies - Search YC companies with filters (batch, status, industry)

• search_yc_founders - Search YC founders by name, company, batch, industry

• search_youtube_videos - Search YouTube videos by query

• get_youtube_video - Get detailed video information by ID or URL

• get_youtube_video_subtitles - Extract video subtitles with timestamps

• search_sec_companies - Search SEC EDGAR filings with advanced filters

• get_sec_document - Retrieve full SEC document content by URL

Search & Discovery (11 tools)

• search_linkedin_users - Advanced user search with 10+ filters

• linkedin_sales_navigator_search_users - Sales Navigator advanced search

• search_linkedin_companies - Search companies with advanced filters

• search_linkedin_educations - Search educational institutions for filtering

• search_linkedin_industries - Search industries for filtering

• search_linkedin_locations - Search locations for filtering

• search_linkedin_jobs - Search job postings with filters

• find_linkedin_user_email - Find users by email address

• get_linkedin_user_email_db - Get email from internal database (up to 10 profiles)

• get_linkedin_google_company - Find companies via Google search

• get_linkedin_company - Company details lookup

User Profiles & Details (12 tools)

• get_linkedin_profile - Full profile with experience, education, skills

• get_linkedin_user_posts - User's post history

• get_linkedin_user_comments - User's comment history

• get_linkedin_user_reactions - Posts user reacted to

• get_linkedin_user_endorsers - Skill endorsers

• get_linkedin_user_certificates - Professional certificates

• get_linkedin_user_education - Education history

• get_linkedin_user_experience - Work experience details

• get_linkedin_user_skills - Skills and endorsements

• get_linkedin_user_honors - Awards and honors

• get_linkedin_user_patents - Patent information

• get_linkedin_user_languages - Language proficiencies

Company Information (4 tools)

• get_linkedin_company_employee_stats - Employee statistics

• get_linkedin_company_employees - Employee list with filters

• get_linkedin_company_posts - Company updates

• get_linkedin_management_company_mentions - Track company mentions (requires ACCOUNT_ID)

Content & Posts (4 tools)

• search_linkedin_posts - Search posts by keywords, author, date

• get_linkedin_post_comments - Comment threads

• get_linkedin_post_reactions - Who reacted and how

• get_linkedin_post_reposts - Reshare analysis

Management & Actions (3 tools) - Require ACCOUNT_ID

• get_linkedin_management_me - Your account profile

• send_linkedin_chat_message - Send direct messages

• get_linkedin_chat_messages - Get conversation history

• get_linkedin_chat_attachment_base64 - Download chat attachments

• send_linkedin_connection_request - Connect with users

• send_linkedin_post_comment - Comment on posts

• send_linkedin_post - Create new posts

• get_linkedin_conversations - Get all conversations

• get_linkedin_user_connections - Get connections list

Groups (1 tool)

• get_linkedin_group - Get group information and members

• get_instagram_user - Profile info, followers, posts count

• get_instagram_user_posts - Post history with media

• get_instagram_user_reels - Reels/videos

• get_instagram_user_friendships - Followers/following lists

• get_instagram_post - Post details with metrics

• get_instagram_post_comments - Comment threads

• get_instagram_post_likes - Who liked the post

• search_instagram_posts - Hashtag and keyword search

• get_twitter_user - Profile details

• search_twitter_users - Find users

• get_twitter_user_posts - Tweet history

• search_twitter_posts - Advanced tweet search with 15+ filters

• search_reddit_posts - Search with sort, time, subreddit filters

• get_reddit_posts - Post details with score, comments

• get_reddit_post_comments - Comment trees with nested replies

• get_reddit_user_posts - Get posts from a specific Reddit user

• get_reddit_user_comments - Get comments from a specific Reddit user

• parse_webpage - Extract content with 14+ CSS selector options

• get_sitemap - Parse website sitemaps

🤝 Integrations

Anysite MCP Server works with any MCP-compatible client:

AI Assistants

• ✅ Claude Desktop - Native OAuth support

• ✅ Cline - MCP configuration

• ✅ Cursor - Custom MCP server

• ✅ Windsurf - MCP integration

• ✅ Any MCP Client - Standard protocol

Development Tools

• 🔧 n8n - Anysite n8n nodes

• 🔧 LangChain - Custom tool integration

• 🔧 AutoGen - Agent tool registration

• 🔧 REST API - Direct API access

Comparison: Remote vs Local

Recommendation: Use Remote MCP for production and Local MCP for development/testing.

🏗️ Architecture

Key Components:

• MCP Protocol Layer - Standardized tool interface for AI agents

• API Abstraction - Platform-specific API adapters with error handling

• Authentication - OAuth 2.0 for secure credential management

• Self-Healing - Auto-retry and fallback mechanisms

• Rate Limiting - Smart backoff to prevent API bans

💡 Use Cases

🎯 Lead Generation & Sales

• Find decision makers by title, company, location

• Enrich CRM data with LinkedIn profiles

• Monitor competitor hiring and expansion

📊 Market Intelligence

• Track brand mentions across platforms

• Analyze competitor social media strategy

• Monitor industry trends and discussions

🔍 Research & Analytics

• Collect datasets for AI training

• Social network analysis

• Content performance tracking

🤖 AI Agent Workflows

• Multi-platform data correlation

• Automated outreach campaigns

• Cross-platform identity resolution

🛠️ Development

Building from Source

Project Structure

Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

Areas we need help with:

• 📝 Documentation improvements

• 🐛 Bug fixes and testing

• ✨ New platform integrations

• 🌍 Translations

📊 Pricing & Limits

Free Tier

• ✅ 100 free credits on signup

• ✅ All 65+ tools available

• ✅ OAuth authentication

• ⚠️ Rate limits apply

Pro Plans

• 🚀 Higher rate limits

• 🚀 Priority support

• 🚀 Dedicated proxies

• 🚀 Team collaboration

See pricing details

🔒 Security & Privacy

• OAuth 2.0 - Industry-standard authentication

• No Credential Storage - Your API keys stay with Anysite

• Encrypted Transport - All data transmitted over HTTPS

• GDPR Compliant - Data processing follows EU regulations

• Revocable Access - One-click disconnect in dashboard

⚠️ Important: Always comply with platform terms of service and local regulations when scraping data.

💬 Community & Support

• 📖 Documentation

• 💬 Discord Community - Ask questions, share workflows

• 🐦 Twitter - Latest updates

• 📧 Email Support

• 🐛 GitHub Issues

📄 License

This project is licensed under the MIT License.

🙏 Acknowledgments

Built with:

• Model Context Protocol by Anthropic

• TypeScript

• Node.js

Special thanks to the MCP community for feedback and contributions.

⭐ Star us on GitHub if Anysite MCP Server helps your AI agents!

Made with ❤️ by the Anysite.io team

Website • Documentation • API Playground