The web-browser-mcp-server enables AI assistants to browse and extract content from web pages through the Message Control Protocol (MCP) interface.
Capabilities:
- Browse websites: Access and retrieve content from any webpage by providing its URL
- Extract content: Capture full webpage content or target specific elements using CSS selectors
- Handle complex pages: Process and analyze content from modern, dynamic websites
- Structured data extraction: Capture specific data points, metadata, titles, links and sections
- Flexible integration: Easily integrate with MCP-enabled systems and workflows
- Error handling: Manage request timeouts and handle errors
The server leverages CSS selectors for smart content extraction from web pages, allowing targeted retrieval of specific elements from websites.
✨ Features
🌐 Enable AI assistants to browse and extract content from the web through a simple MCP interface.
The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.
🤝 Contribute • 📝 Report Bug
✨ Core Features
- 🎯 Smart Content Extraction: Target exactly what you need with CSS selectors
- ⚡ Lightning Fast: Built with async processing for optimal performance
- 📊 Rich Metadata: Capture titles, links, and structured content
- 🛡️ Robust & Reliable: Built-in error handling and timeout management
- 🌍 Cross-Platform: Works everywhere Python runs
🚀 Quick Start
Installing via Smithery
To install Web Browser Server for Claude Desktop automatically via Smithery:
Installing Manually
Install using uv:
For development:
🔌 MCP Integration
Add this configuration to your MCP client config file:
For Development:
💡 Available Tools
The server provides a powerful web browsing tool:
browse_webpage
Browse and extract content from web pages with optional CSS selectors:
⚙️ Configuration
Configure through environment variables:
Variable | Purpose | Default |
---|---|---|
REQUEST_TIMEOUT | Webpage request timeout in seconds | 30 |
🧪 Testing
Run the test suite:
📄 License
Released under the MIT License. See the LICENSE file for details.
Made with ❤️ by the Pear Labs Team
Related MCP Servers
- AsecurityAlicenseAqualityAn advanced web browsing server enabling headless browser interactions via a secure API, providing features like navigation, content extraction, element interaction, and screenshot capture.Last updated -69PythonMIT License
- AsecurityAlicenseAqualityProvides functionality to fetch web content in various formats, including HTML, JSON, plain text, and Markdown.Last updated -4125,855353TypeScriptMIT License
- AsecurityFlicenseAqualityEnables browser automation using Python scripts, offering operations like taking webpage screenshots, retrieving HTML content, and executing JavaScript.Last updated -418Python
- AsecurityAlicenseAqualityEnables browser automation with Puppeteer, supporting navigation, form interactions, and connection to active Chrome instances for comprehensive web page interaction.Last updated -84708TypeScriptMIT License