web-scraping-mcp-server
Server Details
Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.
Glama couldn't complete the latest health check. If this server requires authentication, missing or expired test credentials may be the cause. A test profile lets Glama authenticate for health checks and discover tools; it is separate from your personal connections.
If you are the author, claim ownership, then add or update a test profile under Admin → Test Profile.
- Status
- Unhealthy
- Uptime
- 68.0% over 58 days
- Last Tested
- Transport
- Streamable HTTP
- URL
TDQS
Scored across 3 tools
Each tool targets a distinct source: crawl_website for general sites, google_search for search results, and wikipedia_lookup for Wikipedia articles. There is no overlap or ambiguity in their purposes.
All tool names follow a consistent lowercase_underscore style, with clear action-oriented naming (crawl_website, google_search, wikipedia_lookup). The convention is uniform across the entire server.
With only 3 tools, the server is well-scoped for basic web retrieval tasks. Each tool fills a distinct role, and the count is within the ideal range for a focused MCP server.
The tool set covers core web scraping activities: crawling a site, searching the web, and retrieving a specific knowledge article. A minor gap is the lack of a standalone fetch tool for a single URL, but crawl_website with max_pages=1 can serve that purpose.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
3 tool updates
- First observed
crawl_website - First observed
google_search - First observed
wikipedia_lookup
Related MCP Connectors
Paid fallback for public webpages: clean text, Markdown, links, metadata, and JavaScript rendering.
PDFs, JavaScript pages and ordinary HTML as clean Markdown. Follows robots.txt per RFC 9309.
Web MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.
x402 sitemap discovery and URL extraction for agents. $0.0001 per emitted URL.
Related MCP Servers
- AlicenseNot gradedqualityCmaintenanceA general-purpose MCP server for crawling and extracting structured data from any website. Supports tools for crawling, single-page extraction, search-and-crawl, and schema extraction.2MIT
- FlicenseNot gradedqualityBmaintenanceMCP server that retrieves bot-unfriendly page content as Markdown and screenshots as vision-ready image tiles, escalating through increasingly sophisticated extraction tiers (plain HTTP, trafilatura, TLS impersonation, headless Chromium) only as needed.-
- AlicenseAqualityDmaintenanceTurns public websites into portable SKILL.md files via MCP using Firecrawl.110 npmMIT
- AlicenseNot gradedqualityDmaintenanceMCP server that fetches raw HTML content from a given URL to provide web context to LLMs.1-
Glama MCP Gateway
Add one secure layer between your agents and this server.