Playwright Fetch MCP Server
A Model Context Protocol server that provides web content fetching capabilities using Playwright for browser automation. This server enables LLMs to retrieve and process JavaScript-rendered content from web pages, converting HTML to markdown for easier consumption.
Author
Created by Wyatt Roersma with assistance from Claude Code.
Key Features
- Browser Automation: Uses Playwright to render web pages with full JavaScript support
- Content Extraction: Automatically identifies and extracts main content areas from web pages
- Markdown Conversion: Converts HTML to clean, readable markdown
- Pagination Support: Handles large content through pagination
- Robots.txt Compliance: Respects robots.txt directives for autonomous fetching
- Proxy Support: Allows routing requests through a proxy server
- Docker Ready: Available as pre-built Docker images via Docker Hub and GitHub Container Registry
Available Tools
playwright-fetch
- Fetches a URL using Playwright browser automation and extracts its contents as markdown.url
(string, required): URL to fetchmax_length
(integer, optional): Maximum number of characters to return (default: 5000)start_index
(integer, optional): Start content from this character index (default: 0)raw
(boolean, optional): Get raw content without markdown conversion (default: false)wait_for_js
(boolean, optional): Wait for JavaScript to execute (default: true)
Prompts
- playwright-fetch
- Fetch a URL using Playwright and extract its contents as markdown
- Arguments:
url
(string, required): URL to fetch
Requirements
- Python 3.13.2 or newer
- uv package manager
- Playwright browsers installed
Installation
1. Install with uv (recommended)
Alternatively, clone the repository and install:
2. Using Docker
You can use our pre-built Docker images from Docker Hub or GitHub Container Registry:
Or build it yourself:
Configuration
Configure for Claude.app
Add to your Claude settings:
Configure for VS Code
For manual installation, add the following JSON block to your User Settings (JSON) file in VS Code.
Command Line Options
The server supports these command-line options:
--user-agent
: Custom User-Agent string--ignore-robots-txt
: Ignore robots.txt restrictions--proxy-url
: Proxy URL to use for requests--headless
: Run browser in headless mode (default: True)--wait-until
: When to consider navigation succeeded (choices: "load", "domcontentloaded", "networkidle", "commit", default: "networkidle")
Example Usage
Debugging
You can use the MCP inspector to debug the server:
Differences from Standard Fetch Server
This implementation differs from the standard fetch MCP server in these ways:
- Browser Automation: Uses Playwright to render JavaScript-heavy pages
- Content Extraction: Attempts to extract main content from common page structures
- Wait Options: Configurable page loading strategy (wait for load, DOM content, network idle)
- Visible Browser Option: Can run with a visible browser for debugging
License
This project is licensed under the MIT License. See the LICENSE file for details.
hybrid server
The server is able to function both locally and remotely, depending on the configuration or use case.
Tools
Playwright 브라우저 자동화를 사용하여 웹 콘텐츠 가져오기 기능을 제공하므로 LLM이 웹 페이지에서 JavaScript로 렌더링된 콘텐츠를 검색하고 처리하고 HTML을 마크다운으로 변환하여 더 쉽게 사용할 수 있습니다.
Related Resources
Related MCP Servers
- AsecurityFlicenseAqualityA server that enables browser automation using Playwright, allowing interaction with web pages, capturing screenshots, and executing JavaScript in a browser environment through LLMs.Last updated -1211,2821TypeScript
- AsecurityFlicenseAqualityEnables LLMs to perform browser automation through the Playwright framework with Chrome DevTools Protocol support, connecting to existing Chrome instances for advanced web interactions and JavaScript execution.Last updated -1228TypeScript
- AsecurityAlicenseAqualityA Model Context Protocol server that provides browser automation capabilities using Playwright, enabling LLMs to interact with web pages, take screenshots, generate test code, scrape web content, and execute JavaScript in real browser environments.Last updated -3111,282TypeScriptMIT License
- -securityFlicense-qualityA minimal server that exposes Playwright browser automation capabilities through a simple API, enabling webpage interaction, DOM manipulation, and content extraction via the Model Context Protocol.Last updated -1Python