Search the web to find relevant pages, returning URLs, titles, and snippets immediately for pre-scraping discovery.
Apache 2.0
650,441 tools. Updated 2026-10-13 08:58
"A tool or software for web scraping" matching MCP tools:
- Search Apify and Crawlee docs via full-text queries to find relevant pages on platform features, SDKs, CLI, REST API, and web scraping libraries.MIT
- Discover a domain's sitemap or traverse internal anchor links to return a canonical URL tree, helping agents navigate sites before scraping.MIT
- Run a Nikto web server vulnerability scan against a target URL on a remote Kali machine to detect dangerous files, outdated software, and common misconfigurations.MIT
- Fingerprint a target URL's web technologies, CMS, frameworks, server software, and plugin versions on a remote Kali machine via PwnBridge.MIT
- Check real-time train ticket prices for routes in Spain. Uses web scraping to provide actual pricing with pagination support.MIT
Matching MCP Servers
- FlicenseAqualityAmaintenanceEnables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.2-
- AlicenseAqualityAmaintenanceEnables fetching any public web page through managed proxies, with optional JavaScript rendering, returning markdown, text, HTML, or structured JSON.1192 npm32 PyPI11MIT
Matching MCP Connectors
- web-scrapingOAuth
Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.
Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.
- Extract structured data and text content from web pages using specific instructions and a defined schema for scraping information.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content collection.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schema for scraping, information gathering, or content collection.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content retrieval.Apache 2.0
- Extract structured data and text from web pages by providing specific instructions and a defined schema for scraping content.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping, information gathering, or content collection.Apache 2.0
- Extract structured data and text from web pages using specific instructions and JSON schema for scraping content or gathering information.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and JSON schemas for scraping information, gathering content, or pulling targeted data from websites.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and a defined schema for data scraping and information gathering.Apache 2.0
- Extract structured data and text content from web pages using specific instructions and defined schemas for scraping, information gathering, or content retrieval.Apache 2.0
- Extract structured data from web pages by specifying instructions and a JSON schema. Ideal for scraping specific content like product details, articles, or lists.Apache 2.0
- Extract clean readable content from up to 20 URLs: text, title, author, date. Eliminates scraping. Feed web pages into AI agent context windows.MIT
- Search Apify and Crawlee documentation by keyword to find relevant platform, SDK, CLI, API, or web scraping guides, then fetch full pages via URL.MIT
- List software categories with tool counts to identify valid category slugs for filtering search results.MIT
- Convert HTML to clean Markdown with GFM support for tables and strikethrough. Ideal for scraping web content for LLM processing.MIT