ZapFetch MCP Server
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@ZapFetch MCP Server Scrape the top post from news.ycombinator.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
@zapfetchdev/mcp-server
MCP (Model Context Protocol) server for ZapFetch — APAC-native web scraping API for AI agents.
Use ZapFetch directly from Claude Desktop, Cursor, Windsurf, and any other MCP-compatible client.
Tools
zapfetch_scrape— scrape a single URLzapfetch_search— web search with optional content extractionzapfetch_crawl— crawl a website (async, returns job_id)zapfetch_crawl_status— poll crawl job progresszapfetch_map— discover URLs on a site (fast, no content)zapfetch_extract— extract structured data with a prompt + schemazapfetch_extract_status— poll extract job progress
Docs: https://docs.zapfetch.com
For docs lookups, Claude/Cursor/Windsurf can also use the auto-generated Mintlify MCP at https://docs.zapfetch.com/mcp.
Related MCP server: multi-scraper-mcp
Prerequisites
Node.js 20+
A ZapFetch API key (get one here)
Install
npm install -g @zapfetchdev/mcp-serverConfigure
Claude Desktop
Edit ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):
{
"mcpServers": {
"zapfetch": {
"command": "npx",
"args": ["-y", "@zapfetchdev/mcp-server"],
"env": {
"ZAPFETCH_API_KEY": "zf-your-api-key"
}
}
}
}Cursor
Edit ~/.cursor/mcp.json:
{
"mcpServers": {
"zapfetch": {
"command": "npx",
"args": ["-y", "@zapfetchdev/mcp-server"],
"env": { "ZAPFETCH_API_KEY": "zf-your-api-key" }
}
}
}Windsurf
Edit ~/.codeium/windsurf/mcp_config.json:
{
"mcpServers": {
"zapfetch": {
"command": "npx",
"args": ["-y", "@zapfetchdev/mcp-server"],
"env": { "ZAPFETCH_API_KEY": "zf-your-api-key" }
}
}
}Install via Smithery
For a one-command install that auto-writes the config for your MCP client:
npx -y @smithery/cli install @zapfetchdev/mcp-server --client claude
# or --client cursor, --client windsurfSmithery will prompt for your ZapFetch API key once, then register the server in the right config file for you. This invokes the package's STDIO entry (bin.zapfetch-mcp → dist/index.js) — identical to the manual configs above.
Environment Variables
Variable | Required | Default | Description |
| STDIO | — | Your ZapFetch API key (STDIO mode only — HTTP mode takes the key per-request via |
| no |
| Override for self-host / dev |
| HTTP |
| HTTP server port (HTTP mode only) |
| Docker |
| Inside the Docker image only, switches between |
Usage Examples
After configuration, ask your AI assistant naturally — it will pick the right tool automatically.
Scrape a single page
"Scrape https://rakuten.co.jp and give me the main content as markdown."
Uses zapfetch_scrape. Best for a known URL where you want raw page content quickly. If the page is geo-blocked or returns sparse content, follow up with a search instead.
Search the web
"Find the top 5 recent blog posts about TypeScript 5.7 and summarize each one."
Uses zapfetch_search. Returns ranked results with optional content extraction. Useful when you don't have a specific URL yet, or as a fallback when a direct scrape comes up empty.
Crawl a site (multi-page)
"Crawl https://docs.example.com starting from the root, up to 50 pages, and summarize the authentication section."
Uses zapfetch_crawl to kick off an async job (returns a job_id), then zapfetch_crawl_status to poll until complete. The assistant handles the polling loop — you just wait for the result.
Tip: For large sites, map first (see below) to identify which URLs are worth crawling before committing.
Map a site (URL discovery)
"List all URLs under https://docs.example.com/api so I can decide which pages to scrape."
Uses zapfetch_map. Returns URLs only — no content fetched — so it's fast even on large sites. Pair with zapfetch_scrape to cherry-pick the pages you actually need:
"Map https://stripe.com/docs, then scrape the 3 pages most relevant to webhook setup."
Extract structured data
"Extract product name, price, currency, and stock status from these 5 rakuten.co.jp product URLs. Return as a JSON array."
Uses zapfetch_extract with a prompt and optional JSON schema. The job is async — zapfetch_extract_status polls it to completion. Good for turning arbitrary product pages, job listings, or articles into structured records at scale.
Poll extract job status
"Check whether the extract job job_abc123 is done."
Uses zapfetch_extract_status directly. You rarely need to ask for this by name — the assistant calls it automatically after zapfetch_extract — but it's useful if you started a job in a previous session and want to retrieve results later.
Combining tools
Tools compose naturally. A few common patterns:
Survey then scrape: map a large site to get all URLs, filter to the relevant ones, scrape each.
Search then scrape: search to find the canonical source for a topic, then scrape that page for full content.
Scrape with fallback: if
zapfetch_scrapereturns thin content (e.g. JS-heavy page), the assistant can fall back tozapfetch_searchto find a cached or mirror version.
Migrating from Firecrawl MCP
ZapFetch is Firecrawl-compatible at the API level, but this MCP uses zapfetch_* tool names (not firecrawl_*) to avoid conflicts if you run both. Capabilities are 1:1 — just update prompts referring to tool names.
HTTP transport (self-hosted)
For hosted / multi-tenant deployments, run the HTTP server instead of STDIO. Each request carries its own API key via Authorization: Bearer, so a single deployment can serve many users without sharing credentials.
Docker
docker run -d \
-p 3000:3000 \
-e ZAPFETCH_TRANSPORT=http \
docker.io/zapfetchdev/mcp:latestFrom npm
npm install -g @zapfetchdev/mcp-server
# then run the HTTP entry (never the STDIO one in this mode)
zapfetch-mcp-httpEndpoints
Path | Auth | Behavior |
| none | Returns |
|
| MCP JSON-RPC endpoint. Requests MUST include |
Example call
curl -X POST http://localhost:3000/mcp \
-H "Authorization: Bearer fc-YOUR-KEY" \
-H "Content-Type: application/json" \
-H "Accept: application/json, text/event-stream" \
-d '{"jsonrpc":"2.0","id":1,"method":"tools/list"}'Security notes
Do not set
ZAPFETCH_API_KEYin HTTP mode. The server refuses to start (exit code 2) if the env var is present — this prevents a misconfigured container from silently serving every request from the operator's key.The HTTP server is stateless: each request builds its own transport + client, with the Bearer token flowing to the MCP tool handler via the SDK's native
extra.authInfo.tokenchannel. No cross-request state, no session leaks.Upstream ZapFetch API error strings are sanitized before transiting to HTTP clients — only a small allowlist of error codes (rate_limit, invalid_key, quota_exceeded, upstream_unavailable) passes through.
The stderr access log is strict-allowlist: only
ts / method / path / status / ms / origin_ip. Bearer tokens, bodies, and headers are never logged.
Development
pnpm install # or npm install
npm run typecheck
npm run build # -> dist/Local test with Claude Desktop pointed at your build:
{
"mcpServers": {
"zapfetch-dev": {
"command": "node",
"args": ["/absolute/path/to/zapfetch-mcp/dist/index.js"],
"env": { "ZAPFETCH_API_KEY": "zf-..." }
}
}
}License
MIT
Available Tools
7 toolszapfetch_crawlA
Crawl a website and extract content from multiple pages. Use this when the user wants to gather content from an entire site or section. Returns a job_id for async polling. Long-running — consider asking the user before invoking if the site is large. For a single page, use zapfetch_scrape. For URL discovery only (no content), use zapfetch_map.
Inputs: url (required), limit, maxDiscoveryDepth, includePaths, +2 more.
zapfetch_crawl_statusA
Check the status of a running crawl job. Returns 'scraping' (in progress) or 'completed'/'failed'/'cancelled' (done). When status=completed, returns all crawled page content. Poll every 2-5 seconds until done.
Inputs: job_id (required).
zapfetch_extractA
Extract structured data from one or more URLs using natural language prompt + optional JSON schema. Use this when the user wants JSON-shaped data (not markdown), especially across multiple pages with the same structure (e.g. product listings, job postings, article metadata). Returns a job — poll with zapfetch_extract_status.
Inputs: urls (required), prompt (required), schema.
zapfetch_extract_statusA
Check the status of a running extract job. Returns 'processing' (in progress) or 'completed'/'failed'/'cancelled' (done). When status=completed, returns the extracted structured data for all input URLs. Poll every 2-5 seconds until done.
Inputs: job_id (required).
zapfetch_mapA
Discover all URLs on a website without crawling content. Fast — use this to survey a site before deciding what to crawl. Returns list of URLs, optionally with titles/descriptions. Much cheaper than zapfetch_crawl (no content extraction). Use zapfetch_scrape or zapfetch_crawl on specific URLs from the result.
Inputs: url (required), search, limit, sitemap.
zapfetch_scrapeA
Scrape a single web page. Use this when the user wants to extract the content of ONE specific URL. Returns clean markdown (and other formats) of the page content. For crawling multiple URLs on a site, use zapfetch_crawl instead.
Inputs: url (required), formats, onlyMainContent, waitFor, +2 more.
zapfetch_searchA
Search the web and optionally scrape results. Use this when the user wants to find information across multiple sites — like a programmable Google. Returns structured list of result URLs with titles and snippets. Use zapfetch_scrape to fetch full content of a specific result.
Inputs: query (required), limit, tbs, location.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 7 tools
Each tool has a clearly distinct purpose: crawling multiple pages (zapfetch_crawl), checking crawl status (zapfetch_crawl_status), structured extraction (zapfetch_extract, zapfetch_extract_status), URL discovery (zapfetch_map), single-page scraping (zapfetch_scrape), and web search (zapfetch_search). Descriptions explicitly contrast them, eliminating ambiguity.
Tool names follow a consistent prefix 'zapfetch_' with verb_noun pattern for actions (crawl, crawl_status, extract, extract_status, map, scrape, search). Minor inconsistency: 'crawl' vs 'crawl_status' and 'extract' vs 'extract_status' use a suffix, while others are single verbs. Still highly predictable.
Seven tools cover the core web scraping and search functionality without redundancy. Each tool serves a unique purpose, and the count is appropriate for the domain. Not too few nor too many.
The tool set covers a complete workflow: discover URLs (zapfetch_map), scrape single pages (zapfetch_scrape), crawl multiple pages (zapfetch_crawl), extract structured data (zapfetch_extract), search the web (zapfetch_search), and poll async jobs (zapfetch_crawl_status, zapfetch_extract_status). No obvious gaps for common web scraping tasks.
Maintenance
Related MCP Connectors
Web scraping, extraction and search for AI agents. Hosted MCP with workspace API keys.
Web scraping, browser automation, screenshots and AI data extraction for AI agents via MCP.
Web scraping, search, crawling, structured extraction and research for AI agents.
Public web data for AI agents: scrape any page, plus Google, TikTok, Instagram and Amazon as JSON.
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceProvides 42+ MCP tools for browser automation, web scraping, and search, enabling AI agents like Claude and Cursor to browse, extract data, and run research agents on the live web.8-
- AlicenseNot gradedqualityDmaintenanceEnables lead generation and web scraping through 16 MCP tools, allowing AI clients like Claude, Cursor, and Windsurf to perform scraping tasks via natural language.MIT
- AlicenseAqualityBmaintenanceEnables AI agents to scrape web pages into Markdown, text, HTML, JSON, PDFs, screenshots, and structured data, while managing batch scraping jobs, persistent browser sessions, usage/request history, and docs lookup through native MCP tools.27415 npm3Apache 2.0
- FlicenseNot gradedqualityAmaintenanceEnables language models to perform AI-powered web scraping, structured extraction, search, crawling, schema generation, and scheduled monitoring through an integrated web-scraping API.-