"Semantic code navigation tools for AI agents" matching MCP servers:

Enables browser automation (navigate, screenshot, click, type, etc.) for Claude Code via MCP protocol, with a Chrome extension for configuration.

MCP server for AI agents -- fetch any URL with full JavaScript rendering (Playwright/Chromium) and convert to clean, token-efficient markdown. Works on React, Vue, Angular, and any JS-heavy page. Includes web search, batch fetching, binary file download, LRU cache, SSRF protection, and structured output.

MCP server that gives AI agents access to current web information through web_search and fetch_url tools, using Tavily, Brave, and DuckDuckGo providers with automatic fallback.

Enables AI agents to drive real Google Chrome with stealth and captcha handling, using Patchright to avoid bot detection.

Provides 63 production-ready API tools for AI agents, including web scraping, AI generation, crypto data, OCR, image generation, audio transcription, text-to-speech, email, and domain lookup.

Exposes OpenClaw tools (web search, page fetching, browser automation, PDF analysis, messaging, inter-agent communication, Canvas) as MCP tools for ACP agents.

An MCP server providing 22 pay-per-call utility tools for AI agents (scrape, validate, embed, store, moderate, notify, convert, prevent loops) without accounts or API keys, using USDC payments via the x402 protocol.

Integrates Jina AI Search Foundation APIs to provide web page content extraction and search capabilities. It supports automatic pagination, result caching, and both standard and VIP search endpoints for enhanced information retrieval.

Playwright browser automation tools for MCP enabling navigation, interaction, content extraction, and semantic locators.

Provides comprehensive code analysis (quality, complexity, linting, dependencies, security) and web scraping capabilities (static/dynamic content, API discovery) for development workflows.

Enables AI agents to manage RSS feeds and articles, safely extract full article text, and fetch YouTube transcripts through a token-optimized MCP interface.

YouTube Skills (TranscriptAPI) is the production API for extracting, searching, and analyzing YouTube content at scale. While other tools break when YouTube changes or cap you at 100 requests/day, TranscriptAPI serves 15 million transcripts monthly at 49ms median response time.

Enables AI agents to use pay-per-call web-to-Markdown, structured extraction, crawling, Base token and wallet data, FX rates, and crypto alert tools via USDC payments on Base.

MCP server that fetches web pages, extracts clean markdown (reducing token count), caches results, and provides searchable reading history.

Enables AI agents to run private web searches against a self-hosted SearXNG instance, rerank results with a local model, and fetch or extract pages locally into markdown, including PDFs, with optional caching, crawling, and cited local-LLM answers.

MCP server providing image analysis tools for AI agents, including metadata extraction, favicon discovery, and placeholder generation.

Enables AI agents to extract structured content from URLs, search the web via DuckDuckGo, monitor site availability, and convert HTML to markdown without requiring API keys.

Gives Claude control of a real, headed Chromium browser via Playwright, enabling web navigation, clicking, typing, screenshots, and JavaScript evaluation.

21 web-data tools for AI agents: jobs, hiring signals, news, research and field trends, reviews, Reddit leads, contacts, property, Shopify, events.

Automatically crawls documentation websites, converts them to organized markdown files, and generates condensed cheat sheets. Intelligently categorizes content into tools/APIs and provides local-first access to downloaded documentation.

Provides MCP tools for searching and comparing products on Wildberries (and Ozon planned), including product search, detailed card retrieval, and review fetching, normalized for LLM consumption.

Enables agents to access 30 pay-per-event Apify actors for ad, video, reel, and audio transcripts; Google Trends and keyword demand; job boards; Amazon product data; and Instagram data, charging only per delivered item.

MCP tool server that gives any AI agent the ability to search, scrape, and analyze content across the internet.

Provides 9 utility APIs for AI agents covering DNS, email, IP, QR, WHOIS, URL health, headers, text extraction, and tech detection, with x402 micropayments on Base.

Provides tools to extract the first or all sitemap URLs from a website's robots.txt file.

Enables web searching and fetching pages converted to Markdown through local stdio MCP tools, so Claude Code and other MCP clients connected via third-party relays retain internet access instead of failing with a server-side tool protocol error. Includes paginated reading of long articles, SSRF/private-network blocking, and charset handling for legacy Chinese sites.

An Operit-compatible adapter of the Exa MCP server, enabling web search, code search, and company research capabilities in AI assistants. It fixes MCP handshake compatibility issues, allowing tools like web_search_exa and web_fetch_exa to load and run reliably.

Public leads and enrichment — NPI, podcasts, local businesses, hiring, websites, teams, trends, trucking (8 MCP tools).

Enables extraction of structured item lists from public web pages using the user's own OpenAI, Anthropic, Gemini, or Groq key through an Apify actor, returning one row per item with validation flags.

Checks a website's robots.txt and Cloudflare settings to identify AI crawler blocking. Also generates llms.txt content to improve visibility to AI answer engines.

Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.

Checks a site for AI crawlers: which of 11 AI crawlers its robots.txt lets in, whether its llms.txt follows llmstxt.org, and what its home page says without scripts. Findings with evidence; no scores, no model calls, no telemetry.

Interact with WebScraping.AI API for web data extraction and scraping

Provides web access capabilities for LLMs including search, fetching, content extraction, PDF reading, image viewing, and screenshots.

Trust layer for AI agents: 22 pay-per-call x402 tools for scam and fraud checks, payment pre-flight, wallet screening, policy approvals, contact extraction and company research. Free preview with no wallet; paid calls settle in USDC on Base.

Provides a local MCP server for AI-powered web crawling on Windows, enabling agents to directly crawl and extract web content without requiring WSL.

Enables agents to search and read posts, images, and limited comments across Xiaohongshu, Weibo, Zhihu, and WeChat Official Accounts, with local OCR and traceable sources.

A Model Context Protocol server that provides web search capabilities using Google Custom Search API and webpage content extraction functionality.

Enables AI assistants to fetch, search, and organize menu information from For Five Coffee café. Provides access to complete menu data, category filtering, and item search capabilities through both MCP and REST API interfaces.

An MCP server for global tech intelligence gathering, offering tools for searching Chinese and English web content, GitHub trending, arXiv papers, HN, Exa, SEC filings, Juejin, Zhihu, Bilibili, and A-share financial reports, all without API keys and with direct China access.