"Web scraping and crawling tools" matching MCP servers:

Lets a frontier coding agent delegate research, cataloguing, and long-running computation to a local LLM with guarded filesystem, web, and Python execution tools, preserving the agent's context and tokens.

MCP server that wraps Codex CLI as a subprocess, exposing code execution, web search, and structured output as Model Context Protocol tools.

An MCP server that provides a persistent sandbox for AI coding agents to explore codebases server-side, returning only compact summaries to reduce context consumption.

Provides structured spec-driven development workflow tools for AI-assisted software development with sequential spec creation (Requirements → Design → Tasks). Features a real-time web dashboard for monitoring project progress and managing development workflows.

Provides a set of read-only Kubernetes functions via an MCP server, enabling interaction with Kubernetes clusters through agents or coding assistants like GitHub Copilot.

Enables autonomous task execution by dynamically searching APIs, generating Python tools, and running them on-demand, with built-in web search, scraping, and file operations.

Guides problem-solving by breaking down complex problems into steps and recommending appropriate MCP tools for each stage, with confidence scores and rationales for tool suggestions.

MCP server wrapping DeepSeek's agent harness tools into minimal/standard modes, enabling persistent shell, file editing, search, job management, and more via natural language.

Enables dynamic creation and execution of custom tools/functions in multiple programming languages at runtime, exposing them to MCP clients like Claude.

A Model Context Protocol server that provides PureScript development tools for AI assistants, enabling code analysis, type lookups, and IDE server management without requiring heavy IDE setup.

An MCP server for Roblox that provides tools to execute Luau code, inspect and modify game instances, teleport players, fire remote events, and stream client logs in real-time via a web dashboard.

A comprehensive MCP server providing tools for AI agents to interact with code, including reading symbols, importing modules, replacing text, and sending OS notifications.

Enables AI assistants to perform controlled Linux system administration tasks like reading logs, managing services, cron jobs, WordPress, and executing sandboxed Python code, with strict security constraints.

A meta-MCP server that orchestrates tools from multiple MCP servers, enabling complex Python workflows with loops and conditionals.

A Model Context Protocol server that provides Claude with a dedicated space for structured thinking during complex problem-solving tasks, helping improve its reasoning capabilities.

Enables AI agents to access pay-per-call web unlocking, structured extraction, clean scraping, Python sandbox execution, persistent key-value memory, and clearinghouse task bounties, with settlement via Bitcoin Lightning L402 or Base/Solana USDC x402.

A Model Context Protocol server for time manipulation tasks, enabling AI models to get the current date/time and calculate duration between timestamps.

Enables AI agents to code and debug Commodore PET software using the VICE emulator, with CLI and MCP tools for session control, screen reading, memory manipulation, and testing.

Enables any MCP client to read, search, patch, and execute commands in a codebase, including interactive sessions and git operations, with permission modes and safety boundaries.

Enables AI assistants to leverage Qwen's code analysis capabilities with large context windows, supporting file/directory analysis, sandbox execution, and multiple approval modes for safe code operations.