Skip to main content
Glama
skypher

clawpage-mcp

by skypher

extract_url

Extract any web page into structured JSON, capturing text, tables, prices, contacts, hours, ratings, links, and images. Handles JavaScript-rendered SPAs and bot-blocked sites.

Instructions

Extract and structure a web page into clean JSON. Returns text, tables, prices, contacts, hours, ratings, dates, links, and images. Handles JavaScript-rendered SPAs and bot-blocked sites. Requires an API key (from register) or x402 payment. Cached URLs are free.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesThe URL to extract
syncNoWait for result inline (default: true)
api_keyNoAPI key from register (cpk_ prefix). Required for uncached URLs unless using x402.
tx_hashNoTransaction hash for x402 payment proof (alternative to API key)
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It discloses key traits: requires API key or payment, cached URLs are free, and the tool handles bot-blocked sites. It does not mention potential rate limits, failure behavior, or throttling, but covers the most critical operational aspects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Three sentences, no filler. Each sentence adds unique value: the action+output, the capability for complex pages, and the auth/payment model. Information is front-loaded with the core purpose first.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given there is no output schema, the description compensates by listing extracted data types. It covers the tool's purpose, output, edge cases (SPAs, bot-blocking), and operational prerequisites. It lacks explicit error/timeout behavior, but the complexity is moderate and the essential information is present.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and each parameter has a description. The tool description adds value by explaining 'api_key' (from register) and 'tx_hash' (x402 payment) in context, and clarifies that cached URLs are free which affects parameter usage. This goes beyond the schema alone.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description starts with a specific verb and resource: 'Extract and structure a web page into clean JSON.' It clearly enumerates output types (text, tables, prices, etc.) and distinguishes from siblings (register, account_info, add_wallet, deposit), which are all unrelated to web extraction.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Provides clear usage context: handles JavaScript-rendered SPAs and bot-blocked sites, and explains the auth/payment requirements (API key or x402, cached URLs free). However, it does not explicitly state when not to use the tool or name alternative extraction tools, so it stops short of a full 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/skypher/clawpage-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server