Skip to main content
Glama
xiaocang

mcp-fetch-ya

by xiaocang

mcp-fetch-ya

A Model Context Protocol (MCP) server for fetching web content and converting HTML to markdown.

Features

  • HTML to Markdown - Automatically extracts main content using Readability and converts to clean markdown

  • robots.txt Compliance - Respects robots.txt by default (configurable)

  • Custom User-Agent - Configurable User-Agent string

  • Proxy Support - Optional HTTP/HTTPS proxy configuration

Installation

npm install -g mcp-fetch-ya@latest

Or use directly with npx:

npx mcp-fetch-ya@latest

Usage with Claude Desktop

Add to your Claude Desktop configuration (~/Library/Application Support/Claude/claude_desktop_config.json on macOS):

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": ["mcp-fetch-ya@latest"]
    }
  }
}

With options

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "mcp-fetch-ya@latest",
        "--ignore-robots-txt",
        "--user-agent", "MyBot/1.0"
      ]
    }
  }
}

With proxy

{
  "mcpServers": {
    "fetch": {
      "command": "npx",
      "args": [
        "mcp-fetch-ya@latest",
        "--proxy-url", "http://proxy.example.com:8080"
      ]
    }
  }
}

Tool: fetch_ya

If the built-in web fetch tool fails, you can retry with this MCP tool as a fallback. Fetches a URL and returns the content. HTML pages are converted to markdown for easier reading.

Parameters

Parameter

Type

Required

Default

Description

url

string

Yes

-

The URL to fetch

raw

boolean

No

false

Return raw content without markdown conversion

CLI Options

Option

Description

--user-agent <agent>

Custom User-Agent string

--proxy-url <url>

Proxy URL for requests

--ignore-robots-txt

Ignore robots.txt restrictions

License

MIT

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/xiaocang/mcp-fetch-ya'

If you have feedback or need assistance with the MCP directory API, please join our Discord server