Skip to main content
Glama

Web page extract: title, meta, OG, headings, links, readable text

web_extract
Read-onlyIdempotent

Fetch one public web page politely (checks robots.txt first and refuses disallowed paths; identifies itself as MoneyMakerBot) and return status, final URL after redirects, title, language, meta description, canonical, favicon, Open Graph/Twitter tags, JSON-LD types, h1-h3 outline, link counts with a sample, and the readable text of // (scripts and styles stripped, up to max_chars, default 20,000). No JavaScript rendering. Private hosts are refused. Failed fetches return an error status, so x402 clients are not charged. Price: $0.002 USDC on Base per call, paid with x402 (MCP transport: an unpaid call returns the x402 PaymentRequired object; retry with params._meta["x402/payment"]). Same tool over HTTP: GET /api/web-extract.

Input Schema

NameRequiredDescriptionDefault
urlYespublic http(s) URL
max_charsNooptional text limit, 500-50000 (default 20000)

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the readOnly/openWorld/idempotent annotations, the description discloses many important behaviors: robots.txt checks, bot identification, redirect handling, JavaScript limitations, private-host refusal, failure semantics, and the x402 payment flow. It also explains that failed fetches do not charge clients, which is critical context for a paid tool.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is front-loaded with the core action and then packs in the extraction fields, limitations, and payment details without filler. It is a dense single paragraph, so readability could improve with structure, but every sentence carries relevant information for invoking the tool correctly.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, and the description compensates by listing the returned fields and explaining failure behavior and payment semantics. Given the tool's complexity, the description provides enough information for an agent to call it correctly and understand what to expect.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so both url and max_chars are already well documented by the schema. The description reinforces the default text limit and adds the x402 payment retry metadata path, but it does not add substantial new syntax or constraints for the declared input parameters beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb and resource: fetching one public web page and extracting structured page data. It clearly distinguishes this from the sibling tools, which are mostly crypto, policy, and AI utilities, and enumerates the returned fields so the agent knows exactly what kind of extraction this is.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives clear usage constraints: public pages only, robots.txt respected, no JavaScript rendering, private hosts refused, and failed fetches returning an error status. It does not name an alternative sibling tool, but none of the siblings appear to overlap with web page extraction, so the context is sufficient.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources