Skip to main content
Glama
socialcrawl

Socialcrawl

Official

socialcrawl-mcp

Give your AI agent access to 44 platforms — social media, commerce & product reviews, app stores, places & travel, business reputation, web research, full web scraping & browser automation, prediction markets, search trends, cross-platform Prism composites, and a universal cross-platform meta-search — through a single API

npm MCP Registry Platforms Endpoints License: MIT mcp MCP server

Overview | Installation | Setup | Usage | Tools | Platforms


Overview

socialcrawl-mcp is an MCP (Model Context Protocol) server that connects AI agents to the SocialCrawl API — a unified data API covering 44 platforms and 357 endpoints.

Retrieve profiles, posts, comments, search results, trending content, and analytics from TikTok, Instagram, YouTube, Twitter/X, LinkedIn, Reddit, GitHub, Hacker News, Polymarket, and 30 more platforms. Pull products, reviews, and sellers from Amazon and Google Shopping; apps, charts, and reviews from Google Play and the Apple App Store; places, hotels, and traveler reviews from Tripadvisor and Google Business; brand reputation from Trustpilot; Korean search across 11 Naver corpora; cross-web brand mentions with sentiment via Content Analysis; Google News headlines and Google Finance quotes — plus web research via Tavily and Perplexity, AI-powered X search via Grok, and a single /search/everywhere endpoint that fans out across 12+ sources in one call.

New in this release: a major LinkedIn expansion (44 endpoints — full profiles & company pages, posts/reposts/reactions, comments & replies, people & company-people search, structured profile sub-resources, jobs, company insights, and groups), deeper Instagram coverage (followers/following, similar accounts, post likers, stories, tagged & location feeds, post-reshare stats, engagement analytics, and one-call reels/posts feeds with per-item share counts), and new YouTube capabilities (trending & advanced search, autocomplete suggestions, playlist items, and downloadable media files — audio, video, subtitles, thumbnails). Alongside the Prism family — server-side composite endpoints that fan out across many platforms and fold the results into one report (universal URL lookup, full comments harvesting, cross-source reputation, share-of-voice, brand-mention and consumer-demand nowcasts, AI consensus answers, crisis radar, creator vetting, and video/app/product intelligence). One API key, one consistent response format, every platform.

What the MCP server does:

  • Discovers available platforms and endpoints dynamically

  • Fetches live social media data on your behalf

  • Validates requests locally before making API calls (saves credits)

  • Provides built-in API documentation the agent can query on demand

Related MCP server: Rolli MCP

Installation

Remote server (hosted — no install)

Connect straight to the hosted Streamable HTTP endpoint — nothing to install or run:

Claude Code (works in the CLI and Claude Code on the web / cloud sandboxes)

claude mcp add --scope user --transport http socialcrawl https://mcp.socialcrawl.dev/mcp \
  --header "Authorization: Bearer sc_your_key_here"

Any client that reads .mcp.json

{
  "mcpServers": {
    "socialcrawl": {
      "type": "http",
      "url": "https://mcp.socialcrawl.dev/mcp",
      "headers": { "Authorization": "Bearer ${SOCIALCRAWL_API_KEY}" }
    }
  }
}

Cursor / Windsurf / VS Code — choose the HTTP ("streamable-http") server type with the same URL and header. x-api-key: sc_your_key_here works as an alternative header.

The discovery tools (socialcrawl_list_platforms, socialcrawl_list_endpoints, socialcrawl_get_docs) work without a key, so you can explore before signing up. claude.ai custom connectors (Settings → Connectors) require OAuth, which ships in a follow-up release — use the header-based setup above in the meantime.

Prefer running it locally? Every stdio option below works exactly as before.

npm

npm install -g socialcrawl-mcp

Available on npm. Most users don't need this — the MCP client configs below use npx and auto-install on first run.

Claude Code (quickest)

claude mcp add --scope user socialcrawl -- npx -y socialcrawl-mcp

Then set your API key:

claude mcp add-env socialcrawl SOCIALCRAWL_API_KEY sc_your_key_here

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Cursor

Add to .cursor/mcp.json in your project root or ~/.cursor/mcp.json globally:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

VS Code (Claude Code)

Add to .vscode/mcp.json in your project or your user settings:

{
  "servers": {
    "socialcrawl": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Windsurf

Add to your Windsurf MCP configuration:

{
  "mcpServers": {
    "socialcrawl": {
      "command": "npx",
      "args": ["-y", "socialcrawl-mcp"],
      "env": {
        "SOCIALCRAWL_API_KEY": "sc_your_key_here"
      }
    }
  }
}

Other MCP-compatible clients

Any MCP client that supports stdio transport can use this server. The general pattern is:

  • Command: npx

  • Args: ["-y", "socialcrawl-mcp"]

  • Environment: SOCIALCRAWL_API_KEY set to your API key

Restart your AI client after saving the configuration.

Setup

1. Get your API key

Sign up at socialcrawl.dev and grab your API key from the dashboard. Every account starts with 100 free credits — no credit card required.

2. Add the key to your config

Replace sc_your_key_here in the installation config above with your actual API key (starts with sc_).

TIP

You can also setSOCIALCRAWL_API_KEY as a system environment variable instead of putting it in the MCP config. The discovery and documentation tools work even without a key — only actual API requests need one.

Usage

Ask your AI agent in natural language. The MCP server handles the rest.

Fetch a profile

Get the TikTok profile for @charlidamelio

The agent calls socialcrawl_request with platform: "tiktok", resource: "profile", params: { handle: "charlidamelio" } and returns structured profile data including followers, bio, verification status, and engagement metrics.

Search across platforms

Search YouTube for "machine learning tutorials"

Get post comments

Get the comments on this Instagram post: https://instagram.com/p/CwA1234abcd

Cross-platform research

Compare the follower counts of @mkbhd on TikTok, Instagram, YouTube, and Twitter

The agent makes 4 sequential API calls — one per platform — and compiles the results into a comparison.

Explore available endpoints

What social media platforms can you access?
Show me all the TikTok endpoints

Access documentation

How does the SocialCrawl credit system work?

Example response

Every response follows a unified envelope format:

{
  "success": true,
  "platform": "tiktok",
  "endpoint": "/v1/tiktok/profile",
  "data": {
    "content": { "text": "...", "media_urls": ["..."] },
    "author": { "username": "charlidamelio", "followers": 156000000 },
    "engagement": { "likes": 5200, "engagement_rate": 0.045 },
    "metadata": { "language": "en", "content_category": "entertainment" }
  },
  "credits_used": 1,
  "credits_remaining": 99
}
NOTE

The same response structure is returned for every platform — no per-platform parsing logic needed.

Available Tools

The MCP server exposes 7 tools:

Tool

Description

Needs API key?

socialcrawl_list_platforms

Discover all 44 platforms with their endpoints and capabilities

No

socialcrawl_list_endpoints

See all endpoints, required parameters, and credit costs for a platform

No

socialcrawl_request

Make any SocialCrawl API call — profiles, posts, comments, search, trends, analytics, Prism composites. GET endpoints take query params; POST batch endpoints (e.g. youtube/videos, prism/profiles) take their array/object body. Supports an optional idempotencyKey for retry-safe calls.

Yes

socialcrawl_check_balance

Check remaining credits and recent deduction summary. Calls /v1/credits/balance — costs 0 credits.

Yes

socialcrawl_monitors

Create and manage stateful monitors that re-run any recipe on a cadence, deliver results to a signed webhook, and accumulate a time-series. Actions: create, list, get, runs, timeseries, pause, resume, delete.

Yes

socialcrawl_web

Full web scraping & browser automation (the web platform). Sync scrape/search/map/extract; async crawl/batch_scrape/agent jobs with poll/cancel; stateful monitors; interactive browser sessions. One action per endpoint.

Yes

socialcrawl_get_docs

Access detailed API documentation by topic or platform

No

Three of the seven tools work without an API key — they query local bundled data. socialcrawl_request, socialcrawl_check_balance, socialcrawl_monitors, and socialcrawl_web require a key.

Monitors — schedule any recipe

socialcrawl_monitors wraps any registry endpoint or Prism composite in a scheduled, stateful monitor (/v1/monitors/*). It re-runs the recipe hourly/daily/weekly (or on a cron), delivers each result to an HMAC-signed webhook, raises alerts on metric thresholds or changes, and keeps a per-run time-series you can read back. "Prism answers once; monitors watch it for you." Managing monitors costs 0 credits; each scheduled run bills the recipe's normal cost plus a 1-credit scheduling premium. See socialcrawl_get_docs topic monitors for the full contract.

Web — scrape, crawl, browse

socialcrawl_web drives the full web-scraping and browser-automation surface (the web platform, /v1/web/*) through a single action parameter:

  • Sync readsscrape (URL → markdown/HTML/screenshot/links), search (web search with page content), map (discover a site's URLs), extract (LLM structured data from a page).

  • Async jobscrawl a whole site, batch_scrape many URLs, or agent (autonomous multi-step web task); each returns a job you poll with job_get/job_list and stop with job_cancel.

  • Monitorsmonitor_create/list/get/update/delete/checks re-check a URL on a cadence and deliver changes to a webhook.

  • Sessionssession_create/get/list, session_execute (run code in the live page), session_close.

Pricing varies by action (scrape 1cr, search 2cr, extract & session_create 5cr, agent 25cr; job/monitor/session management 0cr). See socialcrawl_get_docs topic web.

Smart validation

Before making any API call, socialcrawl_request validates locally that the platform exists, the endpoint exists, and all required parameters are present. If something is wrong, it tells the agent exactly how to fix it — without consuming any credits.

Retry-safe requests

Pass an idempotencyKey to socialcrawl_request (UUIDv4 recommended) to make the call retry-safe. If the request is replayed within 24h, the server returns the original response and deducts 0 credits (X-Idempotent-Replay: true).

Supported Platforms

Platform

Endpoints

Data Available

LinkedIn

44

Profiles & company pages, posts, reposts, reactions, comments & replies, people/company-people search, profile sub-resources (experience, education, skills, certifications…), jobs (search, company jobs, details), company insights, groups, transcripts, Ad Library, profile-360

Instagram

33

Profiles, posts, reels, comments (incl. single-comment lookup), highlights, stories, tagged & location feeds, followers/following, similar accounts, post likers, reshare stats, one-call reels/posts feeds with share counts, engagement analytics, search (reels/hashtag/profile/location/music), trending, transcripts, profile-360

Prism

33

Cross-platform composites — URL lookup, comment harvesting, batch comment-lookup & profile-lookup, handle-audit, brand mentions, demand signals, AI visibility, crisis radar/post-mortem, reputation, share-of-voice, creator vetting, AI consensus answers, video/app/product intelligence

YouTube

28

Channels, videos, shorts, comments & replies, sponsors, playlists & items, community posts, search (advanced + autocomplete), trending, live streams, media files (audio/video/subtitles/thumbnails), transcripts, batch videos/channels/transcripts, profile-360

Facebook

22

Pages, posts, comments, groups, photos, reels, events, Marketplace, transcripts, full Ad Library

Web Scraping

22

Scrape, web search, site map, LLM extract, async crawl/batch-scrape/agent jobs, change monitors, interactive browser sessions, document parse — driven by socialcrawl_web

TikTok

20

Profiles, videos, comments & replies (incl. single-comment lookup), search, trending, audience, followers, live, songs, transcripts, profile-360

GitHub

12

Users, repos, issues, PRs, READMEs, releases, search, repo dossier, user profile-velocity

Naver

12

Korea's #1 portal — blog, news, book, encyclopedia, cafe, KiN, local, shopping, doc, image, web search, brief

Content Analysis

10

Cross-web brand mentions, sentiment, rating distributions, phrase/category trends

Google

10

Web search, Ads Transparency, Business Profile (info, reviews, updates, Q&A), Travel hotels

Apple App Store

9

App search, search suggestions, app details, reviews, charts, listings database, reference data

Google Play

9

App search, search suggestions, app details, reviews, charts, listings database, reference data

Twitter/X

8

Profiles, tweets, communities, video transcripts, AI search via Grok, profile-360

Reddit

7

Subreddits, posts, comments, search, transcripts, omni-search VoC sweep

Spotify

6

Artists, tracks, albums, podcasts, episodes, search

Amazon

5

Product search, ASIN details, reviews, sellers, shop pages

Pinterest

5

Pins, boards, search, URL save-counts

Rumble

5

Search, channel videos, video details, comments, transcripts

Threads

5

Profiles, posts, keyword search, user search

TikTok Shop

5

Products, reviews, listings, search, creator showcases

Google Shopping

4

Product search, product details, cross-retailer reviews, sellers

Hacker News

4

Story search, story, comment tree, profile

Tavily

4

Web search (with LLM answer), URL extraction, sitemap, full crawl

Twitch

4

Profiles, clips, videos, schedules

Bluesky

3

Profiles, posts

Google Finance

3

Instrument quotes, markets overview, ticker search

Kwai

3

Profiles, posts

Truth Social

3

Profiles, posts

Google Trends

2

Interest-over-time (explore) + rising/breakout related queries

Tripadvisor

2

Place search, traveler reviews

Trustpilot

2

Business search, company reviews

Universal Search

2

One query fanned out across 12+ platforms (20cr); forums lane

Google News

1

Real-time Google News SERP search

Kick

1

Clips

Komi

1

Link pages

Linkbio

1

Link pages

Linkme

1

Link pages

Linktree

1

Link pages

Perplexity

1

Sonar web research with cited sources

Pillar

1

Link pages

Polymarket

1

Prediction-market research — multi-query fan-out + ranking

Snapchat

1

Profiles

Utility

1

Age & gender detection

Total: 357 endpoints across 44 platforms.

Error Handling

The MCP server handles errors gracefully and gives the agent actionable guidance:

Error

What the agent sees

Missing API key

Prompts to set SOCIALCRAWL_API_KEY with link to sign up

Invalid API key

Asks to check the key configuration

Insufficient credits

Shows balance and links to billing page

Bad platform/resource

Suggests using discovery tools to find the right endpoint

Missing parameters

Lists exactly what's missing with examples

Resource not found (404)

Reports the upstream resource doesn't exist; credits auto-refunded (BIL-01)

Idempotency-Key conflict (409)

Tells the agent the key was used by another account — generate a fresh one

Idempotency-Key payload mismatch (422)

Tells the agent the same key was reused with different params

Method not allowed (405)

Reminds the caller that /v1/* is GET-only

Concurrency limit (429)

Asks the caller to back off (50 concurrent/key max)

Upstream error (502)

Reports the failure; credits refunded automatically

Platform unavailable (503)

Circuit breaker open; credits refunded; retry in 30s

Install Server
A
license - permissive license
A
quality
D
maintenance

Maintenance

Maintainers
Response time
Release cycle
Releases (12mo)
Commit activity

Related MCP Servers

  • A
    license
    A
    quality
    A
    maintenance
    Real-time X (Twitter) data platform with 2 MCP tools covering 120+ REST API endpoints. Search tweets, look up users, get timelines, extract followers/likes/retweets in bulk, monitor accounts, run giveaway draws, and perform write actions (tweet, like, retweet, follow, DM). OAuth 2.1 authentication with PKCE.
    Last updated
    2
    366
    172
    MIT

View all related MCP servers

Related MCP Connectors

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/socialcrawl/mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server