mcp-scrapingant
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcp-scrapingantextract product title and price from https://example.com/product"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
mcp-scrapingant
ScrapingAnt MCP — wraps the ScrapingAnt web scraping API (scrapingant.com)
Part of Pipeworx — an MCP gateway connecting AI agents to 1683+ live data sources.
Tools
Tool | Description |
| Scrape a web page and return its raw HTML via ScrapingAnt (headless-browser rendering + rotating proxies). Handles JS-heavy sites and anti-bot pages. Example: scrapingant_scrape({ url: "https://example.com", browser: true, _apiKey: "your-key" }) |
| Fetch a web page and return clean, LLM-ready Markdown (boilerplate stripped) via ScrapingAnt. Ideal for feeding page content to a model. Example: scrapingant_markdown({ url: "https://example.com/article", _apiKey: "your-key" }) |
| Extract structured data from a web page using ScrapingAnt AI extraction. Describe the fields you want in |
Related MCP server: Scrapfly MCP
Quick Start
Add to your MCP client (Claude Desktop, Cursor, Windsurf, etc.):
{
"mcpServers": {
"scrapingant": {
"url": "https://gateway.pipeworx.io/scrapingant/mcp"
}
}
}What this endpoint actually serves
tools/list at https://gateway.pipeworx.io/scrapingant/mcp returns the tools in the table
above plus the shared Pipeworx meta-tools — ask_pipeworx,
discover_tools, search_within, remember/recall and the rest of the
gateway-wide set. So the tool count you see is larger than this table: a
single-pack endpoint currently lists roughly 30 shared tools alongside the
pack's own. The connection's initialize response states its exact scope, and
is the authoritative answer for a given day.
This is deliberate, not multiplexing by accident. The meta-tools are what let a
scoped connection answer a question this pack does not cover — via
ask_pipeworx, which routes across the whole catalog — without you adding a
second MCP server. There is currently no way to mount a pack endpoint without
them; if the extra schemas cost you more context than the routing is worth,
connect to the full gateway once rather than to several pack endpoints.
Or connect to the full Pipeworx gateway to get every pack's tools listed directly, instead of just this one's:
{
"mcpServers": {
"pipeworx": {
"url": "https://gateway.pipeworx.io/mcp"
}
}
}Both URLs reach the same gateway and the same 1683+ data sources. The
only difference is which pack's tools are listed directly; ask_pipeworx
reaches all of them from either one.
No MCP client? Call it over HTTP
This pack takes your own API key (_apiKey) — we don't front one for it, so there's no curl here that would run without it. Inspect any tool: GET https://gateway.pipeworx.io/v1/tools/scrapingant_scrape. Find one: POST https://gateway.pipeworx.io/v1/tools/search_packs with {"query":"..."}.
Standalone (no gateway account)
This package also runs as a local stdio MCP server — no Pipeworx account, no gateway round-trip:
{
"mcpServers": {
"scrapingant": {
"command": "npx",
"args": ["-y", "@pipeworx/mcp-scrapingant"]
}
}
}Or run it directly to confirm it starts:
npx -y @pipeworx/mcp-scrapingantIt speaks MCP over stdin/stdout and answers initialize/tools/list/tools/call
for only this pack's tools — none of the shared meta-tools the gateway
connection above adds. Same source, same tools, no ask_pipeworx routing.
Using with ask_pipeworx
Instead of calling tools directly, you can ask questions in plain English — this works on the pack endpoint above as well as on the full gateway:
ask_pipeworx({ question: "your question about Scrapingant data" })The gateway picks the right tool and fills the arguments automatically.
More
License
MIT
This server cannot be deployed
Maintenance
Related MCP Connectors
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Scrape any URL into clean LLM-ready Markdown, or crawl a whole site.
Unblocking and fresh web data for agents: URL to Markdown, YouTube, Maps, Amazon, jobs. Pay per call
Cloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceEnables web scraping and crawling capabilities for LLM clients, supporting single-page scraping, multi-page website crawling, and web search with multiple engines (Playwright, Cheerio, Puppeteer) and flexible output formats including markdown, HTML, text, and screenshots.9 npm6MIT
- AlicenseAqualityBmaintenanceGives AI assistants real-time access to web data with the ability to scrape any website, bypass anti-bot systems, extract structured data, and capture screenshots through enterprise-grade infrastructure.6272 npm14ISC
- AlicenseAqualityDmaintenanceEnables web scraping of URLs, including extracting text, links, images, metadata, taking screenshots, and using CSS selectors for structured data extraction.610 npmMIT
- AlicenseNot gradedqualityBmaintenanceEnables scraping web pages through ScraperAPI's rotating proxies, with options for markdown output, JavaScript rendering, geotargeting, and premium proxies, as well as structured Amazon product/search and Google search results.456 npmMIT