Robot Resources Scraper
Related Servers
Alternatives to Robot Resources Scraper
No user-submitted related servers found.
Related Servers
- AlicenseAqualityDmaintenanceConverts web pages and HTML strings into clean, LLM-optimized Markdown with metadata extraction and token estimation. It uses a lightweight, browserless approach to provide token-efficient output for more effective LLM processing.2MIT
- AlicenseAqualityBmaintenanceFast, token-efficient web content extraction tool that converts websites to clean Markdown for AI agents, featuring smart caching, content extraction with Mozilla Readability, and polite crawling capabilities.11,198 npm160MIT

stripfeed-mcp-serverofficial
AlicenseAqualityBmaintenanceConverts any URL to clean, token-efficient Markdown for AI agents. Strips ads, navigation, and scripts. Supports CSS selectors, batch processing (10 URLs), token counting, and smart caching.33 npmMIT- AlicenseNot gradedqualityDmaintenanceA context-optimized web scraping server that converts HTML to markdown/text and applies CSS selectors server-side, reducing token usage by 70-90% while providing AI tools with clean, filtered web content.7MIT
- AlicenseAqualityAmaintenanceWeb content extraction for AI agents. 10 tools: scrape, crawl, map, batch, extract, summarize, diff, brand, search, research. Uses TLS fingerprinting to bypass anti-bot without a headless browser. Outputs LLM-optimized markdown with 67% fewer tokens than raw HTML.102,360AGPL 3.0
- FlicenseNot gradedqualityDmaintenanceFetches web pages and converts them to clean, readable markdown format by extracting main content while removing navigation, ads, and other non-essential elements to minimize token usage.4-
TDQS
Scored across 2 tools
The two tools have clearly distinct purposes: scraper_compress_url handles single-page compression, while scraper_crawl_url performs multi-page crawling with BFS link discovery. There is no overlap or ambiguity between them.
Both tools follow a consistent verb_noun pattern (scraper_compress_url and scraper_crawl_url), using the same prefix and snake_case style throughout. The naming is predictable and uniform.
With only two tools, the server feels thin for a scraper domain, lacking essential operations like error handling, configuration, or content filtering. This minimal set may limit agent workflows and cause dead ends.
The tool surface is severely incomplete for web scraping; it misses basic CRUD-like operations such as updating crawl parameters, deleting cached data, or retrieving specific page elements. Agents will struggle with incomplete coverage.