"Web scraping and content extraction" matching MCP servers:

Enables AI agents to inspect any public domain’s web technology stack, email deliverability and DNS health (MX, SPF, DKIM, DMARC, MTA-STS, TLS-RPT, BIMI), and HTTPS security posture with typed JSON scores and remediation-ready findings, plus history, bulk checks, monitoring alerts, and reverse technology lookups.

Enables a chat session's owner to reach any host through arbitrary HTTP methods with custom headers and bodies, raw TCP sockets, outbound WebSockets, and browser-grade scraping that solves challenges and discloses explicit failover routing.

Enables an AI agent to read-only inspect Extreme Networks switches over SNMPv3 and optional SSH, retrieving health, interface, VLAN, routing, DHCP, ARP/MAC, logging and fabric-topology data for monitoring and troubleshooting. No write path exists, so agents can look at approved inventory switches without being able to change configuration.

Enables AI agents to control the H3C HCL network simulator through MCP, including creating topologies, adding/starting devices, wiring links, reading console output, and running CLI commands.

Enables an AI agent to perform read-only inspection of Palo Alto Networks Panorama and PAN-OS firewalls for monitoring and troubleshooting, including inventory, health, network, logs, and policy queries. It communicates via the PAN-OS XML API over HTTPS and does not allow configuration changes.

Enables targeted B2B lead discovery, DNS MX deliverability verification, and extraction of web content into clean Markdown for AI agents.

Routes web requests from AI tools through Tor for anonymized fetching, with selective per-URL routing to bypass Tor-blocking sites.

Self-hostable MCP server for WhisperGraph — a graph of 7.39B nodes / 39B edges mapping DNS, BGP, GeoIP, WHOIS, and threat intelligence. Six read-only tools (Cypher query + schema introspection + threat assessment), six resources, eight investigation prompts. stdio and Streamable HTTP transports.

Remote MCP server with 21 tools: 10 Domain Dossier checks (DNS, MX, SPF, DMARC, DKIM, TLS, redirects, headers, CORS, web-surface) plus 10 developer utilities (base64, JWT decode, DNS lookup, UUID v4/v7, URL encode/decode, JSON format, User-Agent parse, IP lookup) and a dossier_full aggregate. Served over Streamable HTTP.

A domain security and privacy checker MCP server that runs locally, performing DNS, TLS, HTTP, and RDAP lookups to generate a scored report covering certificates, email authentication, DNS, and web security headers.

Routes web requests through 175M+ residential IPs across 195+ countries, enabling AI to bypass geo-restrictions and anti-bot systems.

Official MCP server for the BunkerWeb web application firewall. Manage services, instances, IP bans, configuration, plugins, and scheduler jobs over stdio or streamable HTTP.

Manage Caddy web servers from Claude Code, Cursor, and any MCP client with 18 tools + 4 resources covering every endpoint of Caddy's admin API — config, routes, reverse proxies, TLS, PKI, metrics, snapshots.

Enables diagnosing web hosting and server issues by running live HTTP, SSL, DNS, and security-header checks alongside a searchable troubleshooting knowledge base.

MCP server for IntoDNS.ai providing 36 free tools for DNS, DMARC, SPF, DKIM, BIMI, DNSSEC, MTA-STS, FCrDNS, blacklist and email security checks. Citation-grade report snapshots with content hashes. No API key required.

Hand a human a rich interactive UI by URL from any MCP client and get structured data back — forms, approvals, surveys, pickers, editable lists. Round-trip human-in-the-loop for agents.

Lets an MCP client read port, statistics, VLAN and PoE status from TP-Link Easy Smart switches and, when explicitly gated, power-cycle a wedged PoE camera over the LAN without opening the switch's web UI. It talks the switch's HTML/cgi protocol directly, with double-gated writes, dry-run, protected ports, and lockout-aware failure handling.

Control your UniFi network via AI with a lightweight 2-tool MCP server that supports both cloud and local UniFi controllers.

Enables AI assistants to check Proxy302 account usage, browse countries, regions and plans, obtain rotating residential proxy URLs, list dynamic proxies and static IPs, and fetch web pages through a chosen country's exit. It is read-only and spend-free, handing proxy credentials to browsers or Playwright for JavaScript-heavy sites.

MCP server for EMQX that exposes 39 tools across 7 categories for managing clusters, clients, topics, messaging, access control, diagnostics, and data integration, with a web GUI and layered safety controls.

This MCP server helps debug legacy devices behind proxies in OT environments by analyzing web interfaces and generating custom rewrite rules to fix proxy-related issues.

Enables AI agents and automation pipelines to enrich company domains, audit AI-search readiness, convert web pages to clean Markdown, inspect DNS/DMARC security, and batch-process up to 25 domains per request.

Enables management of Caddy web server via admin API, allowing inspection of routes, upstream health, certificates, and configuration reloading.

Enables LLM-based assistants to diagnose network problems from PCAP/PCAPNG packet captures, offering tools for capture summaries, TCP conversation analysis, security anomaly detection, and JSON-RPC extraction without requiring Wireshark.

A comprehensive MCP server for web security reconnaissance, providing tools for passive and active information gathering, DNS analysis, network scanning, and web application analysis.

Visual network topology editor with AI agent integration via MCP. One-click SSH + web-service access from any node, nmap/CSV import, smart auto-layout, multi-sheet, local-first. Open-source successor to netViz (CA Technologies 1990-2012)

Enables AI agents to administer a local Windows machine by listing and controlling services, processes, event logs, ports, network lookups and system diagnostics through sharply typed tools. A built-in web interface lets the operator switch every tool on or off individually, with least privilege as the default.

A hosted MCP server that enables AI agents to interact with the Starlink Enterprise API using service accounts, with transparent OAuth token management and 55 auto-generated tools.

Enables agents to call paid utilities for DNS/SSL checks, site status, summarization, keyphrase extraction, decision advice, data cleanup, claim verification, and grounding via per-call USDC payments over x402, with free discovery tools and no signup or API key.

Gives AI agents ten website and domain research tools, including full domain reports, readable page extraction, DNS lookups, feed and sitemap parsing, link and metadata extraction, site checks, and redirect tracing. Calls are paid per use in USDC on Base via x402 from a configured wallet, so no account, API key, or subscription is required.