mcp-fetch-ya
mcp-fetch-ya
A Model Context Protocol (MCP) server for fetching web content and converting HTML to markdown.
Features
HTML to Markdown - Automatically extracts main content using Readability and converts to clean markdown
robots.txt Compliance - Respects robots.txt by default (configurable)
Custom User-Agent - Configurable User-Agent string
Proxy Support - Optional HTTP/HTTPS proxy configuration
Installation
npm install -g mcp-fetch-ya@latestOr use directly with npx:
npx mcp-fetch-ya@latestUsage with Claude Desktop
Add to your Claude Desktop configuration (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):
{
"mcpServers": {
"fetch": {
"command": "npx",
"args": ["mcp-fetch-ya@latest"]
}
}
}With options
{
"mcpServers": {
"fetch": {
"command": "npx",
"args": [
"mcp-fetch-ya@latest",
"--ignore-robots-txt",
"--user-agent", "MyBot/1.0"
]
}
}
}With proxy
{
"mcpServers": {
"fetch": {
"command": "npx",
"args": [
"mcp-fetch-ya@latest",
"--proxy-url", "http://proxy.example.com:8080"
]
}
}
}Tool: fetch_ya
If the built-in web fetch tool fails, you can retry with this MCP tool as a fallback. Fetches a URL and returns the content. HTML pages are converted to markdown for easier reading.
Parameters
Parameter | Type | Required | Default | Description |
| string | Yes | - | The URL to fetch |
| boolean | No | false | Return raw content without markdown conversion |
CLI Options
Option | Description |
| Custom User-Agent string |
| Proxy URL for requests |
| Ignore robots.txt restrictions |
License
MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/xiaocang/mcp-fetch-ya'
If you have feedback or need assistance with the MCP directory API, please join our Discord server