Search the web to find relevant pages, returning URLs, titles, and snippets immediately for pre-scraping discovery.
Apache 2.0
691,722 tools. Updated 2026-10-23 15:29
"Techniques or Tools for Web Scraping" matching MCP tools:
- Ask Bright Data's support assistant questions about products, APIs, MCP usage, zones, scraping, or account setup, with threaded follow-ups for context.MIT
- Extract structured data and text from web pages using specific instructions and JSON schema for scraping content or gathering information.Apache 2.0
- Retrieve techniques used by software of a threat group via the Group → Software → Techniques relationship.Apache 2.0
- Discover available integrations and apps in Agentled to identify tools for building workflows, including LinkedIn enrichment, email finder, web scraping, and CRM connections.MIT
- Search the HackTricks offensive-security wiki for pentesting techniques, privilege escalation, web vulns, and more. Returns ranked pages with snippets.MIT
Matching MCP Servers
- AlicenseAqualityAmaintenanceEnables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.3196 npmMIT
- AlicenseAqualityAmaintenanceEnables fetching any public web page through managed proxies, with optional JavaScript rendering, returning markdown, text, HTML, or structured JSON.127 npm34 PyPI11MIT
Matching MCP Connectors
- web-scrapingOAuth
Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.
Web/PDF to Markdown, transcription, paper search and citation checks. Pay per call in USDC via x402.
- Convert HTML to clean Markdown with GFM support for tables and strikethrough. Ideal for scraping web content for LLM processing.MIT
- Plans the next documentation lookups for a given MTA:SA task, guiding AI to call the right tools and avoid manual scraping.GPL 3.0
- Retrieve details on known software, malware, or tools, including associated techniques and groups.MIT
- Retrieve all MITRE ATT&CK techniques for enterprise, mobile, or ICS domains. Optionally exclude revoked techniques or include descriptions for comprehensive threat intelligence.Apache 2.0
- Search web pages and retrieve content with optional scraping. Get SERP results or extract full page content in formats like markdown and HTML.MIT
- Extract web content from URLs using Bittensor's decentralized scraping network. Pay per use via blockchain for automated data collection.MIT
- Retrieve Web Application Firewall bypass techniques for specific vulnerability types such as XSS, SQLi, and SSRF.GPL 3.0
- Find freelance web scraping and browser automation leads by scanning tech subreddits for pain points and urgency signals.MIT
- Retrieve French tax information from cached data when web scraping fails, providing reliable access to official tax brackets and calculations for residents.Apache 2.0
- Discover WCAG accessibility techniques to implement web content guidelines. Filter by technology like HTML, ARIA, or CSS and by type such as sufficient or failure techniques.MIT
- Extract focused web content with optimized scraping, limited scrolls, and customizable image extraction for efficient data collection on Prysm MCP Server.MIT
- Search ATT&CK techniques by keyword, tactic, platform, or data source. Find relevant techniques for threat analysis and mapping.MIT
- Create optimized web search queries tailored to specific research tasks, using structured strategies and advanced techniques to enhance information retrieval efficiency for AI agents.MIT
- Search WCAG accessibility techniques by keyword to find implementation methods for web accessibility compliance.MIT
- Generate critical instructions for web scraping tools to handle proxy rotation and bypass anti-bot measures when extracting data from websites.ISC