A
licenseNot graded
qualityD
maintenanceScrapes and indexes documentation websites to provide AI assistants with searchable access to documentation content, API references, and code examples through configurable URL crawling.
ISC
Spider MCP Server
by oeo
Related Servers
Alternatives to Spider MCP Server
No user-submitted related servers found.
Related Servers
- FlicenseNot gradedqualityCmaintenanceCrawl entire websites, sitemaps, and documentation portals into clean, LLM-ready Markdown without ads, cookie popups, or noise for RAG pipelines and AI agents.-
- AlicenseNot gradedqualityAmaintenanceCrawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata for Pinecone, Chroma, pgvector, LangChain, or LlamaIndex.MIT
- AlicenseNot gradedqualityNot gradedmaintenanceCrawls documentation websites and provides semantic search capabilities over the content through vector embeddings, enabling natural language queries of technical documentation.2MIT
- FlicenseNot gradedqualityAmaintenanceEnables AI agents and LLM pipelines to fetch webpages or crawl sites, extract main content, and convert it to clean, token-efficient Markdown with preserved links. It supports configurable crawling depth, caching, robots.txt compliance, and optional chunking for downstream processing.-
- AlicenseNot gradedqualityBmaintenanceEnables AI agents to extract, validate, and discover documentation from websites using llms.txt and install.md standards.13 npm34-
This server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessNo issues