Skip to main content
Glama
xiaobenyang-com

local-fetch

网页抓取服务器

一个功能强大的MCP服务器,提供不受robots.txt限制的网页抓取功能,支持多种HTTP方法和自定义请求设置。 A powerful MCP server that offers web scraping capabilities unrestricted by robots.txt, supports multiple HTTP methods and custom request Settings.## 工具列表 Tool List

本MCP服务封装下列工具,可让模型通过标准化接口调用以下功能。 本MCP服务封装下列工具,可让模型通过标准化接口调用以下功能。

工具 Tool

描述 Description

fetch

Fetch content from a URL without following robots.txt restrictions. Returns the response body as text.

检查服务 ## Inspector

工具在线测试: https://mcp.xiaobenyang.com/inspector/1777316659329027

Online Tool test https://mcp.xiaobenyang.com/inspector/1777316659329027

Related MCP server: Scrapy MCP Server

服务配置 MCP Server Config

如何获取 XBY-APIKEY ? How to get XBY-APIKEY ?

访问小笨羊科技网站 https://xiaobenyang.com,注册用户即可获得APIKEY Visit XiaoBenYang website https://xiaobenyang.com, register and get the APIKEY.

SSE

{
  "mcpServers": {
    "网页抓取服务器": {
      "headers": {
        "XBY-APIKEY": "<YOUR_XBY_APIKEY>"
      },
      "type": "sse",
      "url": "https://mcp.xiaobenyang.com/1777316659329027/sse"
    }
  }
}

STREAMABLE HTTP

{
  "mcpServers": {
    "网页抓取服务器": {
      "headers": {
        "XBY-APIKEY": "<YOUR_XBY_APIKEY>"
      },
      "type": "streamable_http",
      "url": "https://mcp.xiaobenyang.com/1777316659329027/mcp"
    }
  }
}

STDIO

{
    "mcpServers": {
        "网页抓取服务器": {
          "command": "npx",
          "args": [
            "-y",
            "xiaobenyang-mcp"
          ],
          "env": {
            "XBY_APIKEY": "<YOUR_XBY_APIKEY>",
            "mcpId": "1777316659329027",
          },
          "transport": "stdio"
        }
      }
}
A
license - permissive license
Not graded
quality - not tested
D
maintenance

Maintenance

Maintainers
Response time
Release cycle
Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

  • A
    license
    A
    quality
    F
    maintenance
    A powerful web scraping MCP server built on Scrapy and FastMCP that supports multiple scraping methods (HTTP, Scrapy, browser automation), anti-detection techniques, form handling, and concurrent crawling. Designed for commercial environments with enterprise-grade features like intelligent retry mechanisms, performance monitoring, and configurable data extraction.
    10
    3
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    MCP server for fetching web pages without robots.txt restrictions, supporting all standard HTTP methods, custom headers, body, redirect control, and timeout settings.
    7
    MIT
  • F
    license
    Not graded
    quality
    B
    maintenance
    A self-hosted MCP server offering unlimited web search, scraping, and content extraction tools with full-content reads, no truncation, and zero per-request cost.
    3

View all related MCP servers

Related MCP Connectors

  • Free remote MCP server for fetching public web pages through a rotating proxy pool.

  • Official Octoparse MCP server for template discovery, cloud tasks, and structured data export.

  • An MCP server for deep research or task groups

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/xiaobenyang-com/1777316659329027'

If you have feedback or need assistance with the MCP directory API, please join our Discord server