mcp-fetch-ya

A Model Context Protocol (MCP) server for fetching web content and converting HTML to markdown.

Features

• HTML to Markdown - Automatically extracts main content using Readability and converts to clean markdown

• robots.txt Compliance - Respects robots.txt by default (configurable)

• Custom User-Agent - Configurable User-Agent string

• Proxy Support - Optional HTTP/HTTPS proxy configuration

Related MCP server: Website to Markdown MCP Server

Installation

npm install -g mcp-fetch-ya@latest

Or use directly with npx:

npx mcp-fetch-ya@latest

Usage with Claude Desktop

Add to your Claude Desktop configuration (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": ["mcp-fetch-ya@latest"]
    }
  }
}

With options

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "mcp-fetch-ya@latest",
        "--ignore-robots-txt",
        "--user-agent", "MyBot/1.0"
      ]
    }
  }
}

With proxy

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "mcp-fetch-ya@latest",
        "--proxy-url", "http://proxy.example.com:8080"
      ]
    }
  }
}

Tool: fetch_ya

If the built-in web fetch tool fails, you can retry with this MCP tool as a fallback. Fetches a URL and returns the content. HTML pages are converted to markdown for easier reading.

Parameters

CLI Options

License

MIT