web-browser-mcp-server
The web-browser-mcp-server enables AI assistants to browse and extract content from web pages through the Message Control Protocol (MCP) interface.
Capabilities:
Browse websites: Access and retrieve content from any webpage by providing its URL
Extract content: Capture full webpage content or target specific elements using CSS selectors
Handle complex pages: Process and analyze content from modern, dynamic websites
Structured data extraction: Capture specific data points, metadata, titles, links and sections
Flexible integration: Easily integrate with MCP-enabled systems and workflows
Error handling: Manage request timeouts and handle errors
The server leverages CSS selectors for smart content extraction from web pages, allowing targeted retrieval of specific elements from websites.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@web-browser-mcp-server get the latest headlines from the BBC homepage"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
โจ Features
๐ Enable AI assistants to browse and extract content from the web through a simple MCP interface.
The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.
๐ค Contribute โข ๐ Report Bug
Related MCP server: mcp-web-tools
โจ Core Features
๐ฏ Smart Content Extraction: Target exactly what you need with CSS selectors
โก Lightning Fast: Built with async processing for optimal performance
๐ Rich Metadata: Capture titles, links, and structured content
๐ก๏ธ Robust & Reliable: Built-in error handling and timeout management
๐ Cross-Platform: Works everywhere Python runs
๐ Quick Start
Installing via Smithery
To install Web Browser Server for Claude Desktop automatically via Smithery:
npx -y @smithery/cli install web-browser-mcp-server --client claudeInstalling Manually
Install using uv:
uv tool install web-browser-mcp-serverFor development:
# Clone and set up development environment
git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server
# Create and activate virtual environment
uv venv
source .venv/bin/activate
# Install with test dependencies
uv pip install -e ".[test]"๐ MCP Integration
Add this configuration to your MCP client config file:
{
"mcpServers": {
"web-browser-mcp-server": {
"command": "uv",
"args": [
"tool",
"run",
"web-browser-mcp-server"
],
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}For Development:
{
"mcpServers": {
"web-browser-mcp-server": {
"command": "uv",
"args": [
"--directory",
"path/to/cloned/web-browser-mcp-server",
"run",
"web-browser-mcp-server"
],
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}๐ก Available Tools
The server provides a powerful web browsing tool:
browse_webpage
Browse and extract content from web pages with optional CSS selectors:
# Basic webpage fetch
result = await call_tool("browse_webpage", {
"url": "https://example.com"
})
# Target specific content with CSS selectors
result = await call_tool("browse_webpage", {
"url": "https://example.com",
"selectors": {
"headlines": "h1, h2",
"main_content": "article.content",
"navigation": "nav a"
}
})โ๏ธ Configuration
Configure through environment variables:
Variable | Purpose | Default |
| Webpage request timeout in seconds | 30 |
๐งช Testing
Run the test suite:
python -m pytest๐ License
Released under the MIT License. See the LICENSE file for details.
Made with โค๏ธ by the Pear Labs Team
Available Tools
1 toolbrowse_webpageC
Extract content from a webpage with optional CSS selectors for specific elements
Inputs: url (required), selectors.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelogโฆ
TDQS
Scored across 1 tool
With only one tool, there is no possibility of ambiguity or overlap with other tools. The tool's purpose is clearly defined as extracting webpage content with optional element selection.
The single tool name follows a clear verb_noun pattern (browse_webpage). Since there are no other tools to compare against, consistency is inherently perfect.
A single tool for a web browser server is too minimal for the apparent scope. Basic web interactions like navigation, clicking, form filling, or handling multiple tabs are missing, making the server feel incomplete and limiting for agents.
The server is severely incomplete for a web browser domain. It only offers content extraction, lacking essential operations such as navigation, interaction with page elements, or session management, which are critical for typical web automation tasks.
Maintenance
Related MCP Connectors
Hosted browser for agents: open pages, search the web, extract data, read PDFs and take screenshots.
Stealth web browser for agents: search, fetch, click, download and type in persistent MCP sessions.
A real browser for your agent: screenshots, page checks, Markdown and PDFs.
Web data for agents. Extract web pages, crawl websites, discover URLs, and search the web.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables web browsing capabilities for locally served LLMs through URL text fetching, link extraction, and web search using Brave and DuckDuckGo engines. Designed to enhance LLMs with real-time web access through the MCP protocol.MIT
- AlicenseAqualityDmaintenanceProvides web access capabilities for LLMs including search, fetching, content extraction, PDF reading, image viewing, and screenshots.346MIT
- AlicenseAqualityDmaintenanceEnables web scraping of URLs, including extracting text, links, images, metadata, taking screenshots, and using CSS selectors for structured data extraction.610 npmMIT
- AlicenseNot gradedqualityCmaintenanceEnables web search via DuckDuckGo and content extraction from URLs using Readability.js.54 npm1Do What The F*ck You Want To Public