Skip to main content
Glama
serper-search-scrape-mcp-server

serper-search-scrape-mcp-server

by marcopesani

Serper Search and Scrape MCP Server

A TypeScript-based MCP server that provides web search and webpage scraping capabilities using the Serper API. This server integrates with Claude Desktop to enable powerful web search and content extraction features.

Features

Tools

  • google_search - Perform web searches via Serper API

    • Rich search results including organic results, knowledge graph, "people also ask", and related searches

    • Supports region and language targeting

    • Optional parameters for location, pagination, time filters, and autocorrection

    • Supports advanced search operators:

      • site: Limit results to specific domain

      • filetype: Limit to specific file types (e.g., 'pdf', 'doc')

      • inurl: Search for pages with word in URL

      • intitle: Search for pages with word in title

      • related: Find similar websites

      • cache: View Google's cached version of a specific URL

      • before: Date before in YYYY-MM-DD format

      • after: Date after in YYYY-MM-DD format

      • exact: Exact phrase match

      • exclude: Terms to exclude from search results

      • or: Alternative terms (OR operator)

  • scrape - Extract content from web pages

    • Get plain text and optional markdown content

    • Includes JSON-LD and head metadata

    • Preserves document structure

Related MCP server: go_serper_mcp_server

Requirements

  • Node.js >= 18

  • Serper API key (set as SERPER_API_KEY environment variable)

Development

Install dependencies:

npm install

Build the server:

npm run build

For development with auto-rebuild:

npm run watch

Run tests:

npm test                  # Run all tests
npm run test:watch       # Run tests in watch mode
npm run test:coverage    # Run tests with coverage
npm run test:integration # Run integration tests

Environment Variables

Create a .env file in the root directory:

SERPER_API_KEY=your_api_key_here

Debugging

Since MCP servers communicate over stdio, debugging can be challenging. We recommend using the MCP Inspector, which is available as a package script:

npm run inspector

The Inspector will provide a URL to access debugging tools in your browser.

Installation

Installing via Smithery

To install Serper Search and Scrape for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @marcopesani/mcp-server-serper --client claude

Claude Desktop

Add the server config at:

  • MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json

  • Windows: %APPDATA%/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "serper-search": {
      "command": "npx",
      "args": ["-y", "serper-search-scrape-mcp-server"],
      "env": {
        "SERPER_API_KEY": "your_api_key_here"
      }
    }
  }
}

Cline

  1. Open the Cline extension settings

  2. Open "MCP Servers" tab

  3. Click on "Configure MCP Servers"

  4. Add the server config:

{
  "mcpServers": {
    "github.com/marcopesani/mcp-server-serper": {
      "command": "npx",
      "args": ["-y", "serper-search-scrape-mcp-server"],
      "env": {
        "SERPER_API_KEY": "your_api_key_here"
      },
      "disabled": false,
      "autoApprove": ["google_search", "scrape"]
    }
  }
}

Additional Cline configuration options:

  • disabled: Set to false to enable the server

  • autoApprove: List of tools that don't require explicit approval for each use

Cursor

  1. Open the Cursor settings

  2. Open "Features" settings

  3. In the "MCP Servers" section, click on "Add new MCP Server"

  4. Choose a name, and select "command" as "Type"

  5. In the "Command" field, enter the following:

env SERPER_API_KEY=your_api_key_here npx -y serper-search-scrape-mcp-server

Docker

You can also run the server using Docker. First, build the image:

docker build -t mcp-server-serper .

Then run the container with your Serper API key:

docker run -e SERPER_API_KEY=your_api_key_here mcp-server-serper

Alternatively, if you have your environment variables in a .env file:

docker run --env-file .env mcp-server-serper

For development, you might want to mount your source code as a volume:

docker run -v $(pwd):/app --env-file .env mcp-server-serper

Note: Make sure to replace your_api_key_here with your actual Serper API key.

Available Tools

2 tools
scrapeC

Tool to scrape a webpage and retrieve the text and, optionally, the markdown content. It will retrieve also the JSON-LD metadata and the head metadata.

Inputs: url (required), includeMarkdown.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

Loading tool schema changelog…

    TDQS

    B3.3/5.0

    Scored across 2 tools

    Disambiguation5/5

    The two tools have clearly distinct purposes: google_search is for performing web searches and retrieving search results, while scrape is for extracting content from a specific webpage. There is no overlap in functionality, making it easy for an agent to choose the right tool for each task.

    Naming Consistency5/5

    Both tools follow a consistent naming pattern using snake_case with descriptive, action-oriented names (google_search and scrape). The naming is straightforward and predictable, with no deviations or mixed conventions.

    Tool Count3/5

    With only 2 tools, the server feels thin for a search-and-scrape domain, as it might lack additional utilities like batch processing, advanced filtering, or result summarization. However, the core functions are covered, making it borderline but functional.

    Completeness4/5

    The tools cover the essential workflows for search and scraping: performing searches and extracting webpage content. Minor gaps exist, such as no tool for managing search history or handling pagination, but agents can work around these with the provided tools.

    Maintenance

    ActivityInactive
    ResponsivenessNo recent community issues

    Related MCP Connectors

    Related MCP Servers

    • A
      license
      A
      quality
      A
      maintenance
      An MCP server that integrates with SerpApi to retrieve search results from multiple search engines including Google, Bing, Yahoo, and others, enabling fast access to both live and archived search data.
      4
      188
      MIT
    • A
      license
      Not graded
      quality
      D
      maintenance
      A Go-based MCP server that provides comprehensive access to the Serper Google Search API, including tools for images, news, maps, and scholar results. It also features a dedicated endpoint for scraping webpage content directly.
      MIT
    • A
      license
      A
      quality
      D
      maintenance
      An MCP server that integrates the SearXNG API for web search and URL content extraction with advanced features like pagination, caching, and proxy support.
      4
      17,815 npm
      2
      MIT