"Web scraping and crawling tools" matching MCP servers:

Enables AI agents to read any web page as clean Markdown and inspect its metadata, structure and technology stack, plus check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains, SEO, broken links, email authentication (SPF/DMARC/DKIM) and SSO (SAML/OIDC). It also provides developer utilities such as cron, regex, color, Unicode and time-zone tools along with Hyperliquid perpetuals market data, all hosted remotely on Apify with pay-per-call pricing.

Routes web requests from AI tools through Tor for anonymized fetching, with selective per-URL routing to bypass Tor-blocking sites.

Compare service-grant changes, tool alias origins, and saved MCP tool definitions with Gooo rules. Reports preserve incomplete-capture uncertainty and source bindings. No grants are applied and no compared tools are invoked.

An MCP server that lets an AI agent probe a live URL and confirm whether sensitive files (e.g., .git, .env, source maps) are genuinely served by fetching and validating the content, avoiding false positives.

An MCP server that exposes 43 domain tools behind 4 meta-tools, applying guardrails such as budgets, rate limits, schema validation, human-in-the-loop confirmation for mutations, PII redaction, and an append-only audit log while reducing context window usage.

MCP server for connecting to SQL Server in readonly mode. Allows any MCP client to explore the schema and run SELECT queries against a SQL Server database.

MCP server that lets AI agents use the Online Cyber Tools catalogue as a set of native MCP tools.

Enables AI agents to run privacy-first network diagnostics (egress IP, proxies, DNS, port checks, security-header audits), handle authentication primitives like TOTP and disposable inboxes, and use developer utilities such as URL-to-markdown reading, webhook inspection, hashing, file/paste sharing, and read-only EVM RPC calls. All tools are free, require no API keys, and operate under a zero-log policy with automatic expiry.

Security intelligence API for AI models. CVE lookup with EPSS/KEV, domain recon (DNS, WHOIS, SSL, subdomains, WAF), and code security checks (secrets, injection, headers). 16 tools, no API key required.

Enables LLM agents to fetch web pages safely, blocking SSRF, downloads, hidden text, and prompt-injection attacks before returning cleaned content.

Post-quantum readiness for AI coding agents: scans code for quantum-vulnerable cryptography (RSA/ECDH/ECDSA/DH) and returns NIST ML-KEM/ML-DSA/SLH-DSA (and hybrid) migration guidance, with fix verification and dependency checks. Content-based, advisory tools only; runs local (npx @quantakrypto/mcp) or as a hosted OAuth endpoint.

MCP server for email deliverability: validate SPF/DKIM/DMARC/BIMI, check blacklists, test SMTP/IMAP, look up DNS, and generate ready-to-deploy records for any major email provider. Ships with two one-click prompts (audit-deliverability, setup-dns). Public, no auth.

Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.

Enables AI assistants to perform authorized web security assessments through MCP tools and a guided review prompt, including passive and full scans, WAF detection, remediation fixes, report export, triage, scan comparison, and proof-of-control verification.

Guardrails for AI coding agents that enforces rules via compliance receipts, blocking destructive actions and syncing rules across all AI tools.

Encrypts local Claude Code and Google Antigravity sessions out of their history and locks chosen ChatGPT, Claude.ai and Gemini web chats behind Touch ID or a passphrase. Any MCP client can hide, list, unlock, read and restore those hidden sessions through its tools.

Enables AI agents to pay per call for live package-safety and GitHub merge-readiness trust signals via the x402 protocol.

A comprehensive suite of HTTP and API testing tools that enables AI agents to perform requests, check endpoint health, and decode JWTs. It also provides utilities for URL parsing and detailed security analysis of HTTP response headers.

Enables querying MITRE ATT&CK and D3FEND data efficiently, providing techniques, detections, mitigations, actors, and countermeasures with token-aware summaries and paginated graph traversal.

Enables checking IP reputations and threat intelligence by querying Chaitin's global honeypot network and millions of defense nodes. Provides real-time IP profiling, malicious behavior detection, and threat alerts based on aggregated security data.