"Web crawling techniques and tools" matching MCP connectors:

25 security tools for AI agents: phishing links, exposure maps, DNS, SSL, PQC, history, pivots.

CertScore.ai MCP LightA

ai.certscore

Free website privacy scanner for pre-consent cookies, trackers, consent, policy, and HTTPS/TLS.

TanodA

dev.tanod

Pay-per-call agent tools: PDF, OCR, translation, news search, prediction markets, web, chain reads.

Inspects live IPv4/IPv6 DNS resolution, TLS certificate issuer/expiry, and HTTP security grade.

HoneyLabsA

net.honeylabs

Honeypot probe data: IP reputation, scanners, CVE probing, TLS and SSH fingerprints.

Contract and agent-package scans, phishing URL and OFAC checks, domain and header checks.

Free AI test helpers: injection inputs, OWASP mapping, release plans, response and tool-call packs.

AI Secret Scanner API is a FastAPI service for deterministic scanning of text, source code, logs, and configuration files. It detects hardcoded secrets, API keys, passwords, tokens, private keys, PII, and high-entropy suspicious strings.

Security scanner for MCP servers and skills: Unicode injection, patterns, secrets.

Hosted, no-auth endpoint of feldspar-scan: free deterministic security scan of a public git repository (OSV.dev vulnerable dependencies, secret patterns, config lint) as structured JSON. Tools: scan_repository(url), audit_pricing(). Stateless streamable-HTTP JSON-RPC, rate-limited. Source: https://github.com/project-feldspar-resources/feldspar-scan (MIT). Operated by Feldspar, an autonomous AI agent (Project Feldspar).

Passive domain-perimeter checks — cert expiry, subdomain takeover, lookalikes — as agent tools

Score any public site's HTTPS, TLS certificate and security headers, with plain fixes. No auth.

Query OSV.dev for package vulnerabilities and batch-audit dependency lists via MCP.

Offline methodology engine for authorized penetration testing, CTF, and security research.

Look up CVEs, CISA KEV, EPSS and open-source package vulnerabilities, including malicious packages.

Search and audit NIST NVD CVEs by keyword, severity, CWE, CISA KEV status, and CPE.

CVE lookups (NVD) and dependency-manifest audits (OSV) for AI agents. No API keys.

Real-time token contract safety scanner and honeypot auditor via x402 on Base.

Scan packages and lockfiles (npm, PyPI, Go, Maven, Cargo, NuGet) for vulnerabilities and malware.

Is a CVE exploited? CISA KEV, FIRST EPSS, CVSS and SSVC with a patch-first verdict. Free, no key.