Skip to main content
Glama
Darshan972

Scrapingdog MCP Server

by Darshan972

Scrapingdog MCP Server

A Model Context Protocol server that exposes the Scrapingdog web-scraping and SERP APIs as tools any MCP-compatible client (Claude Desktop, Claude Code, Cursor, etc.) can call.

One tool per Scrapingdog product — general web scraping, the full Google family, Amazon, Walmart, eBay, LinkedIn, X, YouTube, Bing, Baidu, and screenshots.

Requirements

  • Node.js ≥ 18

  • A Scrapingdog API key — get one on your dashboard.

Related MCP server: mcp-services

Install & build

npm install
npm run build

Configuration

The server reads your API key from the SCRAPINGDOG_API_KEY environment variable. It is never passed as a tool argument, so it stays out of the model's context, transcripts, and logs.

Variable

Required

Default

Description

SCRAPINGDOG_API_KEY

yes

Your Scrapingdog API key.

SCRAPINGDOG_API_BASE

no

https://api.scrapingdog.com

Override the API base URL.

SCRAPINGDOG_TIMEOUT_MS

no

90000

Per-request timeout in milliseconds.

Claude Desktop

Add to claude_desktop_config.json (macOS: ~/Library/Application Support/Claude/claude_desktop_config.json):

{
  "mcpServers": {
    "scrapingdog": {
      "command": "node",
      "args": ["/absolute/path/to/ScrapingdogMCP/dist/index.js"],
      "env": {
        "SCRAPINGDOG_API_KEY": "your_api_key_here"
      }
    }
  }
}

Claude Code

claude mcp add scrapingdog -e SCRAPINGDOG_API_KEY=your_api_key_here -- node /absolute/path/to/ScrapingdogMCP/dist/index.js

Available tools

35 tools. Each tool's full parameter set (with descriptions and API defaults) is generated from src/endpoints.ts and surfaced to the client as the tool's input schema. All paths were validated against the live API except amazon_reviews (⚠️) — see Known issues.

General

Tool

Scrapingdog endpoint

Key required args

web_scrape

/scrape

url

Google family

Tool

Scrapingdog endpoint

Key required args

google_search

/google

query

google_maps

/google_maps

query

google_news

/google_news/v2

— (query or a *_token)

google_trends

/google_trends

query

google_shopping

/google_shopping

query

google_scholar

/google_scholar

query (or cites)

google_jobs

/google_jobs

query

google_finance

/google_finance

query

google_lens

/google_lens

url

google_ai_mode

/google/ai_mode

query

google_ai_overview

/google/ai_overview

url

google_shorts

/google_shorts

query

google_hotels

/google_hotels

query, check_in_date, check_out_date

google_patents

/google_patents

query

google_immersive_product

/google_immersive_product

page_token

google_images

/google_images

query

E-commerce

Tool

Scrapingdog endpoint

Key required args

amazon_search

/amazon/search

query, domain, page, country

amazon_product

/amazon/product

asin

amazon_reviews ⚠️

/amazon/reviews

asin

amazon_offers

/amazon/offers

asin

walmart_search

/walmart/search

url

ebay_search

/ebay/search

url

Social / professional

Tool

Scrapingdog endpoint

Key required args

linkedin_profile

/linkedin

type, linkId

x_profile

/x/profile

profileId

youtube_search

/youtube

search_query

youtube_transcripts

/youtube/transcripts

v

youtube_video

/youtube/video

v

youtube_channel

/youtube/channel

channel_id

youtube_comments

/youtube/comments

v

Other search engines

Tool

Scrapingdog endpoint

Key required args

bing_search

/bing/search

query

baidu_search

/baidu/search

query

universal_search

/search

query

AI / LLM & tools

Tool

Scrapingdog endpoint

Key required args

chatgpt

/chatgpt

prompt

screenshot

/screenshot

url (returns an image)

Known issues

All 35 endpoints were validated against the live API and return data, with one exception:

  • amazon_reviews — the /amazon/reviews route is correct, but the live endpoint currently responds HTTP 400 "Something went wrong" for every input (any ASIN, with or without extra params). This looks like a Scrapingdog backend/plan-scope issue rather than a wrapper bug. It stays marked with verify: true in src/endpoints.ts until it returns data. List flagged endpoints anytime with:

npm run list:unverified

Adding or adjusting an endpoint

Every endpoint is a single declarative object in src/endpoints.ts — no handler code to write. To add a Scrapingdog product (e.g. Google Hotels, Patents, TikTok), append:

{
  tool: "google_hotels",
  title: "Google Hotels API",
  path: "/google_hotels",
  description: "…",
  params: [
    { name: "query", type: "string", required: true, description: "…" },
    // …
  ],
}

Rebuild with npm run build.

Architecture

src/
  types.ts       Endpoint / EndpointParam type definitions
  endpoints.ts   Declarative registry of every Scrapingdog API
  client.ts      HTTP client: URL building, API-key resolution, error handling
  server.ts      Compiles each endpoint into an MCP tool + Zod input schema
  index.ts       stdio entry point

License

MIT

Install Server
A
license - permissive license
B
quality
B
maintenance

Maintenance

Maintainers
Response time
Release cycle
Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

  • A
    license
    -
    quality
    D
    maintenance
    Web scraping MCP server for Al agents. 6 tools: extract clean text/markdown from any URL, structured scraping with CSS selectors, full-page screenshots via Playwright, link extraction with regex filtering, metadata extraction (OG tags, Twitter cards), and Google search. Free tier: 50 requests/IP/day.
    Last updated
    6
    MIT
  • A
    license
    -
    quality
    D
    maintenance
    Multi-tool MCP server for AI agents with 29 tools across web scraping, SEO analysis, screenshot and PDF generation, domain intelligence, content extraction, multi-chain EVM blockchain queries, and security toolkit. Free tier available with no auth required.
    Last updated
    47
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    A comprehensive MCP server providing 15 web tools including search, scraping, screenshots, SEO audits, and DNS/SSL checks through a single installation. It delivers clean, LLM-optimized outputs so AI agents can focus on reasoning rather than parsing raw HTML.
    Last updated
    15
    25
    MIT
  • -
    license
    -
    quality
    C
    maintenance
    Self-hosted MCP server that provides web scraping and crawling tools, integrating seamlessly with AI frameworks like OpenAI Agents SDK, Cursor, and Claude Code.
    Last updated
    4

View all related MCP servers

Related MCP Connectors

  • Hosted MCP with 91 agent tools: X, domains, SEO, Maps, Trends, Search, YouTube, TikTok, and more.

  • MCP server for Google search results via SERP API

  • SerpApi MCP — wraps SerpApi (serpapi.com) search engines

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Darshan972/Scrapingdog-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server