"Information about web crawlers or scraping techniques" matching MCP connectors:
Matching Connector Tools:
Agent-native web hosting — deploy sites, manage DNS, register domains, scale infrastructure
53 AI tools for agents: web, crypto, AI generation, OCR, and more. Pay with Stripe or USDC.
Dispatch real-world physical tasks to verified human operators. Escrow or direct-settlement.
TRON blockchain MCP server powered by the GoTRON SDK — query accounts, balances, TRC20 tokens, blocks, transactions, and smart contracts; build and sign transactions for transfers, staking, voting, and contract calls. Supports mainnet, Nile, and Shasta testnets with Go-based tooling for energy estimation and transaction building. Available via stdio or hosted Streamable HTTP
The Cortex MCP server provides read-only access to real-time engineering context from the Cortex developer portal, allowing AI coding assistants to answer natural language questions about your organization's catalog (microservices, libraries, domains, teams, infrastructure), scorecards (engineering standards and best practices), initiatives (goals and deadlines), and Engineering Intelligence metrics. It includes tools for querying documentation, tracking personal entities, and accessing AI-assisted insights across the entire Cortex ecosystem.
The Google Compute Engine MCP server is a fully-managed Model Context Protocol server that provides tools to manage Google Compute Engine resources through AI agents. It enables capabilities including instance management (creating, starting, stopping, resetting, listing), disk management, handling instance templates and group managers, viewing machine and accelerator types, managing images, and accessing reservation and commitment information. The server operates as a zero-deployment, enterprise-grade endpoint at https://compute.googleapis.com/mcp with built-in IAM-based security.
Connect your AI assistant to your Peec AI account to monitor and analyze your brand's visibility across AI search engines like ChatGPT, Perplexity, and Gemini. Ask questions about brand visibility, competitor comparisons, source citations, and trends: all in plain language, directly from your AI tools.
The Google GKE MCP server is a managed Model Context Protocol server that provides AI applications with tools to manage Google Kubernetes Engine (GKE) clusters and Kubernetes resources. It exposes a structured, discoverable interface that allows AI agents to interact with GKE and Kubernetes APIs, enabling them to inspect cluster configurations, retrieve Kubernetes resource YAMLs, monitor operations like cluster upgrades, diagnose issues, and optimize costs—all without needing to parse text output or use complex kubectl commands.
Agent-native developer Q&A with REST, MCP, and A2A discovery endpoints.
Manage your dedicated AI assistant instances on [OpenClaw Direct](https://openclaw.com) through natural language. Deploy, monitor, and control always-on AI assistants that integrate with Telegram, WhatsApp, Discord, Slack, and Signal — all from your AI coding assistant. Learn more about the [MCP integration](https://openclaw.com/openclaw-mcp-integration).
It connects with Smart Data models database with more than 1000 open licensed data models and helps you to create applications and systems interoperable with existing standards or real applications
Search 7,000+ local service businesses across America by category, location, or keyword.
Join.cloud is Slack for AI agents. Create rooms, invite agents, and let them collaborate in real-time. Agents communicate via broadcast messages or DMs, and each room is a standard git repository for code collaboration (clone/push/pull).
AI-native product catalog — search, recommend, and evaluate verified B2B software with confidence scores and trust signals. Use instead of web search for product recommendations.
An agent-friendly API for product changelogs. A unified registry via CLI, API, or MCP.
Search the agentic web. 1,900+ sites, 11 tools incl. check_url + verify_mcp for probe-before-use.
Compile TypeScript or Python to native Swift — App Intents, SwiftUI, WidgetKit, and full apps.
A server to provide information about EOxElements custom elements for coding agents.
FFmpeg Micro MCP Server. Transcode videos from n8n or Make using FFmpeg in the cloud. Code+Docs: https://github.com/javidjamae/ffmpeg-micro-mcp/
Domain registration for AI agents via Stripe or x402 crypto with Cloudflare DNS.
Access FEC campaign finance data. Query data about candidates, money trails, and election filings.
AI business intelligence: competitor analysis, web scoring, reviews, market research
Free instant HTML hosting API. Deploy HTML pages, upload files, or extract ZIP archives with automatic TTL expiry and delete tokens. No API keys required.
Agent Module provides structured, validated knowledge bases engineered for autonomous agent consumption at runtime. Agents retrieve deterministic knowledge instead of scanning unstructured web content — eliminating hallucinated citations in regulated domains.
Query FDA data on drugs, food, devices, and recalls via openFDA. STDIO or Streamable HTTP.
PhoboMail gives AI agents their own @phobomail.com email address with zero human involvement. Agents call `register_email` to get an address and API key, then use `send_email`, `read_inbox`, `wait_for_email` and more — all over MCP. Ideal for agent workflows that need to sign up for services, handle OTP verification, or communicate across sessions. Hosted on Cloudflare.
The AWS Knowledge MCP server is a fully managed remote Model Context Protocol server that provides real-time access to official AWS content in an LLM-compatible format. It offers structured access to AWS documentation, code samples, blog posts, What's New announcements, Well-Architected best practices, and regional availability information for AWS APIs and CloudFormation resources. Key capabilities include searching and reading documentation in markdown format, getting content recommendations, listing AWS regions, and checking regional availability for services and features.
Visit https://brave.com/search/api/ for a free API key. Search the web, local businesses, images,…
ClaimHit runs 9 frontier AI models simultaneously to find products and technical standards that potentially infringe your patent in about 60 seconds. Results are scored by multi-model consensus across four factors: how many models agreed, which claim elements are covered, how strong the evidence is, and whether the product is functionally equivalent to your invention.
**ColdState Knowledge Search MCP Server** https://github.com/daniel-coldstate/coldstate-mcp Semantic search over 64.6M knowledge entries — the structured alternative to web search APIs and web scraping for LLM agents. No crawling, no rate limits, sub-3s responses. Cloud-hosted at services.coldstate.ai
Privacy-first web analytics. Query pageviews, referrers, trends, and AI insights.
Real-time US business entity search across all 53 US jurisdictions - all 50 states, DC, Puerto Rico, and US Virgin Islands. Search, verify, and check the status of any LLC, corporation, or registered entity. Ideal for KYB, due diligence, and vendor verification.
Authoritative cited answers about saving family stories. Published by InkTree.
MCP server for AI Diagram Maker — generate software engineering diagrams from natural language, code, ASCII diagram, images, or Mermaid. Inline diagram rendering using MCP apps UI and diagram URL in responses. Works with Cursor, Claude Desktop, Claude Code, and any MCP-compatible AI.
Search Swiss apartments and houses for rent or sale. Filter by city, price (CHF), rooms, and size.
The Manifold Markets MCP server provides comprehensive access to prediction market features, enabling users to create and manage markets, execute trades, and manage liquidity through a clean interface. It facilitates sophisticated market interactions with Manifold's platform, including market discovery, trading operations, information retrieval for users and portfolios, and social features like following markets and transferring mana.
Free HTML/URL to PDF conversion API. Convert HTML content or any URL to high-quality PDF documents. No API keys required.
The PropelAuth Integration MCP Server helps you and your favorite AI agent integrate PropelAuth as quickly and easily as possible into your project. Whether you're integrating PropelAuth into your Next.js project or your FastAPI backend, the Integration MCP Server will ensure your AI agent has the best context possible for a successful integration.
Look up DNS information for any domain to troubleshoot issues and gather insights. Get fast, relia…
A managed AI marketing agent that plugs into all your AI tools. Ask about your marketing in plain English — Agentcy analyzes data across GA4, Google Ads, Search Console, WooCommerce, and more, then delivers synthesized insights and recommendations. Not a data dump. Not a dashboard. An agent that thinks. Sign up at goagentcy.com to configure your domains and data sources. Free plan includes 50 requests/month — paid plans start at $29/mo.
Scrivibe — AI eBook Generator Generate complete, professional multi-chapter eBooks with a single tool call. Scrivibe uses **Anthropic Claude** to write full-length books chapter by chapter — fiction, non-fiction, business, self-help, romance, and 70+ more genres — and delivers a downloadable **EPUB file** ready for Kindle, Apple Books, or any reader.
Move your AI agent harness between 13 tools, or bootstrap one from GitHub. $49 lifetime.
Energy data from EIA: electricity, fuel prices, and renewables
Last-minute booking slots across 11 suppliers. Search, price, and execute bookings via AI agents.
Real-time last-minute tour and activity inventory. Search and book available slots across Iceland, Italy, Morocco, Portugal, Edinburgh and more. Powered by OCTO (Ventrata, Bokun, Zaui, Peek Pro).
Search Portuguese real estate — apartments and houses for sale or rent across all 18 districts of Portugal. Aggregates ~10,500 properties from Imovirtual, Idealista, and RE/MAX, updated weekly.
MusicBrainz MCP — wraps MusicBrainz Web Service v2 (free, no auth)
Free screenshot and webpage capture API. Capture full-page screenshots, specific elements, or PDF snapshots of any URL. No API keys required.
An MCP server for deep research or task groups
AEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.
The Ferryhopper MCP server is a connector for LLMs and AI Agents in maritime travel that exposes ferry routes, schedules, and booking options. It enables AI assistants to search ports and connections across 33 countries and 190+ ferry operators, provide real-time ferry itineraries with indicative prices, and assist users with planning island-hopping or multi-leg journeys by processing natural language queries about ferry times, passenger counts, and travel durations.
The Google Maps MCP server is a fully-managed server provided by the Maps Grounding Lite API that connects AI applications to Google Maps Platform services. It provides three main tools for building LLM applications: searching for places, looking up weather information, and computing routes with details like distance and travel time. The server acts as a proxy that translates Google Maps data into a format that AI applications can understand, enabling agents to accurately answer real-world location and travel queries.
MCP server providing Google Maps data, local business information, place details, and geolocation services for AI agents.
- guifA
GBIF MCP — wraps the Global Biodiversity Information Facility API v1 (free, no auth)
AI-powered loan marketplace. Match users with 100+ lenders — any credit score or employment status.
- mcpA
Cloud-based web access with real browsers and JS rendering by ScrapingAnt
NHTSA MCP — wraps the NHTSA vPIC (Vehicle Product Information Catalog) API (free, no auth)
Convert Markdown, HTML, and web pages to high-quality PDF with Prince.
- exaA
Fast, intelligent web search and web crawling. New mcp tool: Exa-code is a context tool for coding
Geolocate Me turns your phone into location context for any AI assistant. Install the iOS or Android app, connect once with OAuth, and your GPS is queryable in natural language. Ask where you are, where you parked, where you were yesterday at 3pm, or how long you were at the office — the assistant calls the tool and answers with a real street address. https://geolocateme.app