Skip to main content
Glama
yoloyash

web-basics-mcp

by yoloyash

web-basics-mcp

为代理提供小巧、可靠的网络工具。无需API密钥,无需捆绑基础设施。

工具

工具

功能描述

web_search

通过现有的 SearXNG 实例搜索一个查询

fetch_url

获取单个页面、文本文档、PDF、图片或 Reddit 帖子

fetch_url 对 HTML 页面和 Reddit 帖子返回干净的 Markdown,对 PDF 返回可选文本,对文本/Markdown/JSON/XML 响应返回直接内容,对 PNG、JPEG、WebP 和 GIF 图片返回原生 MCP 图片内容。

长文本按有界块读取。使用返回的 next_start_index 再次调用同一 URL:

{
  "url": "https://example.com/long-page",
  "start_index": 8000,
  "max_length": 8000
}

成功获取的内容会在内存中缓存五分钟,因此偏移读取通常使用相同的提取文档。搜索结果缓存两分钟,以避免在代理运行期间重复执行相同的 SearXNG 工作。两个缓存都有大小限制,会合并并发的重复请求,并且可能随时被丢弃;工具的正确性从不依赖它们。

Related MCP server: Basic MCP Tools

要求

  • Node.js 20.18.1 或更新版本

  • 一个已启用 JSON 响应的现有 SearXNG 实例

在环境变量或本包的 .env 文件中设置其基础 URL:

SEARXNG_URL=http://127.0.0.1:8088

即使 SearXNG 不可用,服务器也会启动,因此 fetch_url 仍然可用。在 SearXNG 可访问之前,对 web_search 的调用会返回明确的连接错误。

安装

git clone https://github.com/yoloyash/web-basics-mcp.git
cd web-basics-mcp
npm install
npm run build

配置 MCP 客户端通过 stdio 运行 build/index.js。例如:

codex mcp add web-basics -- node /absolute/path/to/web-basics-mcp/build/index.js

工具输入

{
  "query": "Model Context Protocol",
  "limit": 5
}

limit 默认为 5,接受 1 到 10 之间的值。结果使用稳定的结构 {link, title, snippet}。

fetch_url

{
  "url": "https://example.com",
  "start_index": 0,
  "max_length": 8000
}
  • start_index 默认为 0。

  • max_length 默认为 8000,上限为 20000。

  • 文本响应会报告 total_chars、returned_chars、truncated,以及当还有更多内容时报告 next_start_index。

  • HTML 优先使用 Defuddle,并在受限情况下使用 Mozilla Readability 作为后备。响应会报告所选的 extractor 以及适用时的后备原因。

  • Defuddle 的可选网络支持提取器已禁用。所有远程请求都保留在此服务器的已验证 HTTP 路径中。

  • Reddit 帖子 URL 通过 Reddit 的 RSS 源获取,包含帖子及该源中可用的评论。RSS 可能包含比网站更少的评论。

安全与限制

  • 仅接受公共 HTTP(S) URL。

  • 拒绝 URL 凭据、私有主机名、私有 DNS 结果以及不安全的重定向。

  • 每个重定向都独立验证。

  • 请求使用超时、有界重试、响应大小限制和稳定的用户代理。

  • 标准响应和图片上限为 5 MiB;PDF 上限为 15 MiB。

  • 获取缓存遵循 Cache-Control: no-store、no-cache 和 max-age=0。

此服务器有意不提供浏览器自动化、JavaScript 渲染、爬取、身份验证、Cookie、代理/VPN 路由或答案合成。

开发

npm test
npm pack --dry-run

测试使用保存的固定数据和本地存根,而不是重复查询公共服务。

Available Tools

2 tools
fetch_urlA
Read-onlyIdempotent

Fetch one public HTTP(S) URL. Returns clean Markdown for pages and Reddit posts, extracted PDF text, direct text data, or a supported image. Use start_index to continue truncated text.

ParametersJSON Schema
NameRequiredDescriptionDefault
urlYesTarget URL
max_lengthNoMaximum text characters to return
start_indexNoCharacter index to start text content from

Output Schema

ParametersJSON Schema
NameRequiredDescription
urlYes
linksNo
titleNo
contentNo
metadataNo
extractorYes
pageCountNo
truncatedNo
wordCountNo
byteLengthNo
contentTypeYes
start_indexNo
total_charsNo
returned_charsNo
fallback_reasonNo
next_start_indexNo

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare the tool read-only, idempotent, and non-destructive. The description adds useful behavior: it specifies supported content types (Markdown, PDF text, etc.) and discloses that text can be truncated, with a pointer to start_index for continuation. No contradiction with annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two sentences with zero filler. The main action and return types are front-loaded, and the start_index hint is a separate, purposeful clause. Nothing extraneous.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the presence of an output schema and the simple nature of the tool, the description covers the essential aspects: what it fetches, what it returns, and how to handle truncation. It does not mention error cases or rate limits, but those are not critical for correct invocation and are partially implied by the annotations.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% describing all three parameters. The description supplements the start_index parameter by explicitly connecting it to truncated text continuation, which adds semantic value beyond the generic schema description. max_length and url are already well-documented in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Fetch') and the resource ('one public HTTP(S) URL'), and enumerates the output types. This unambiguously distinguishes it from the sibling web_search (which searches rather than fetches a known URL).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage: you should use this tool when you have a specific URL to fetch. However, it never explicitly contrasts with web_search or states when NOT to use it. The only usage hint provided is about start_index for continuing truncated text, which is a parameter-level instruction, not a tool-selection guideline.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 2 tool updatesv0.5.0
    • Changedfetch_url3 fields changed
      • addedInput schema / properties / max_length
        Added value: +{
        +  "default": 8000,
        +  "description": "Maximum text characters to return",
        +  "maximum": 20000,
        +  "minimum": 1,
        +  "type": "integer"
        +}
      • addedInput schema / properties / start_index
        Added value: +{
        +  "default": 0,
        +  "description": "Character index to start text content from",
        +  "minimum": 0,
        +  "type": "integer"
        +}
      • changedOutput schema / (root)
        Previous value: -nullNew value: +{
        +  "$schema": "http://json-schema.org/draft-07/schema#",
        +  "additionalProperties": false,
        +  "properties": {
        +    "byteLength": {
        +      "minimum": 0,
        +      "type": "integer"
        +    },
        +    "content": {
        +      "type": "string"
        +    },
        +    "contentType": {
        +      "type": "string"
        +    },
        +    "extractor": {
        +      "enum": [
        +        "defuddle",
        +        "readability",
        +        "unpdf",
        +        "reddit",
        +        "text",
        +        "image"
        +      ],
        +      "type": "string"
        +    },
        +    "fallback_reason": {
        +      "type": "string"
        +    },
        +    "links": {
        +      "items": {
        +        "type": "string"
        +      },
        +      "type": "array"
        +    },
        +    "metadata": {
        +      "additionalProperties": {
        +        "type": [
        +          "string",
        +          "number",
        +          "boolean",
        +          "null"
        +        ]
        +      },
        +      "type": "object"
        +    },
        +    "next_start_index": {
        +      "minimum": 0,
        +      "type": "integer"
        +    },
        +    "pageCount": {
        +      "minimum": 1,
        +      "type": "integer"
        +    },
        +    "returned_chars": {
        +      "minimum": 0,
        +      "type": "integer"
        +    },
        +    "start_index": {
        +      "minimum": 0,
        +      "type": "integer"
        +    },
        +    "title": {
        +      "type": "string"
        +    },
        +    "total_chars": {
        +      "minimum": 0,
        +      "type": "integer"
        +    },
        +    "truncated": {
        +      "type": "boolean"
        +    },
        +    "url": {
        +      "type": "string"
        +    },
        +    "wordCount": {
        +      "minimum": 0,
        +      "type": "integer"
        +    }
        +  },
        +  "required": [
        +    "url",
        +    "contentType",
        +    "extractor"
        +  ],
        +  "type": "object"
        +}
    • Changedweb_search5 fields changed
      • addedInput schema / properties / max_tokens
        Added value: +{
        +  "description": "Provider answer token cap when supported",
        +  "exclusiveMinimum": 0,
        +  "type": "integer"
        +}
      • addedInput schema / properties / num_search_results
        Added value: +{
        +  "description": "Requested search breadth or local result cap",
        +  "maximum": 10,
        +  "minimum": 1,
        +  "type": "integer"
        +}
      • addedInput schema / properties / recency
        Added value: +{
        +  "description": "Relative time filter",
        +  "enum": [
        +    "day",
        +    "week",
        +    "month",
        +    "year"
        +  ],
        +  "type": "string"
        +}
      • addedInput schema / properties / temperature
        Added value: +{
        +  "description": "Provider sampling temperature when supported",
        +  "type": "number"
        +}
      • changedOutput schema / (root)
        Previous value: -nullNew value: +{
        +  "$schema": "http://json-schema.org/draft-07/schema#",
        +  "additionalProperties": false,
        +  "properties": {
        +    "error": {
        +      "type": "string"
        +    },
        +    "response": {
        +      "additionalProperties": false,
        +      "properties": {
        +        "answer": {
        +          "type": "string"
        +        },
        +        "authMode": {
        +          "type": "string"
        +        },
        +        "citations": {
        +          "items": {
        +            "additionalProperties": false,
        +            "properties": {
        +              "citedText": {
        +                "type": "string"
        +              },
        +              "title": {
        +                "type": "string"
        +              },
        +              "url": {
        +                "type": "string"
        +              }
        +            },
        +            "required": [
        +              "url",
        +              "title"
        +            ],
        +            "type": "object"
        +          },
        +          "type": "array"
        +        },
        +        "model": {
        +          "type": "string"
        +        },
        +        "provider": {
        +          "enum": [
        +            "brave",
        +            "duckduckgo",
        +            "exa",
        +            "firecrawl",
        +            "none",
        +            "searxng"
        +          ],
        +          "type": "string"
        +        },
        +        "relatedQuestions": {
        +          "items": {
        +            "type": "string"
        +          },
        +          "type": "array"
        +        },
        +        "requestId": {
        +          "type": "string"
        +        },
        +        "searchQueries": {
        +          "items": {
        +            "type": "string"
        +          },
        +          "type": "array"
        +        },
        +        "sources": {
        +          "items": {
        +            "additionalProperties": false,
        +            "properties": {
        +              "ageSeconds": {
        +                "type": "number"
        +              },
        +              "author": {
        +                "type": "string"
        +              },
        +              "publishedDate": {
        +                "type": "string"
        +              },
        +              "snippet": {
        +                "type": "string"
        +              },
        +              "title": {
        +                "type": "string"
        +              },
        +              "url": {
        +                "type": "string"
        +              }
        +            },
        +            "required": [
        +              "url",
        +              "title"
        +            ],
        +            "type": "object"
        +          },
        +          "type": "array"
        +        },
        +        "usage": {
        +          "additionalProperties": false,
        +          "properties": {
        +            "inputTokens": {
        +              "type": "number"
        +            },
        +            "outputTokens": {
        +              "type": "number"
        +            },
        +            "searchRequests": {
        +              "type": "number"
        +            },
        +            "totalTokens": {
        +              "type": "number"
        +            }
        +          },
        +          "type": "object"
        +        }
        +      },
        +      "required": [
        +        "provider",
        +        "sources"
        +      ],
        +      "type": "object"
        +    }
        +  },
        +  "required": [
        +    "response"
        +  ],
        +  "type": "object"
        +}
  2. 2 tool updatesv1.0.0
    • First observedfetch_url
    • First observedweb_search

TDQS

A3.9/5.0

Scored across 2 tools

Disambiguation5/5

The two tools perform fundamentally different operations: one searches the web, the other fetches a specific URL. There is zero overlap in purpose, so an agent can clearly distinguish which tool to use for a given task.

Naming Consistency4/5

Both tools use a verb_noun pattern ('web_search' and 'fetch_url'), which is consistent and readable. 'web_search' could be parsed as 'search the web' but the prefix 'web_' is used similarly, so the pattern is predictable. Minor deviation: 'web_search' vs 'fetch_url' both place the verb first, so it's actually consistent.

Tool Count3/5

With only two tools, the server feels minimal, which is on the borderline for a dedicated web-basics server. Both tools are essential and non-redundant, but the count is thin—though it may be appropriate for a focused utility server.

Completeness4/5

For a 'web-basics' domain, search and fetch cover the core operations an agent would need. The fetch tool handles multiple content types and page truncation, which is good. Minor gaps exist (e.g., no way to submit forms or list search history), but these are not expected for a basics server.

Maintenance

ActivitySlowing
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • F
    license
    A
    quality
    D
    maintenance
    MCP server that provides a search_web tool to query a self-hosted SearXNG instance and return structured web search results.
    1
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    A self-hosted MCP server providing private web search, web page fetching, and current date/time tools, powered by a bundled SearXNG instance for API-key-free local search.
    2
    -