Skip to main content
Glama
n24q02m

WET - Web Extended Toolkit

extract

Read-only

Get clean content from web pages or local files. Use batch extraction, deep crawling, file conversion, structured data extraction, multi-step research, or browser interaction to gather information.

Instructions

Read and return full page content from URLs or local files. Use this when you have a specific URL and need its content. For finding URLs first, use the search tool instead.

Actions:

  • extract: Get clean content from URLs. Example: extract(action="extract", urls=["https://example.com/article"])

  • batch: Batch extract with per-domain rate limiting (max 50 URLs). Example: extract(action="batch", urls=["https://a.com/1", "https://b.com/2"])

  • crawl: Deep crawl following links from root URLs. Example: extract(action="crawl", urls=["https://docs.example.com"], depth=2)

  • map: Discover site URL structure without extracting content. Example: extract(action="map", urls=["https://example.com"])

  • convert: Convert local files (PDF, DOCX, PPTX, XLSX) to Markdown. Example: extract(action="convert", paths=["/home/user/report.pdf"])

  • extract_structured: Extract structured data using JSON Schema + LLM. Example: extract(action="extract_structured", urls=["https://example.com/pricing"], schema={"type": "object", "properties": {"price": {"type": "string"}}})

  • agent: Multi-step research orchestration -- search the web, extract top results, synthesize a cited Markdown answer. Example: extract(action="agent", query="latest pydantic 2 changes", max_urls=5)

  • interact: Drive a page with click/fill/submit via patchright. Example: extract(action="interact", url="https://example.com/login", actions=[{"type": "fill", "selector": "#email", "value": "x@y.com"}, {"type": "submit", "selector": "form"}])

Key parameters:

  • urls (required for extract/batch/crawl/map/extract_structured): List of URLs

  • paths (required for convert): List of local file paths

  • query (required for agent): Research question to answer

  • url (required for interact): Page URL to drive

  • actions (required for interact): List of {type, selector?, description?, value?} ops

  • max_urls (agent): Default 5, hard cap 20

  • synthesis_model (agent): Override LLM model for the synthesis step

  • token_budget (agent): Max prompt tokens (default 10000)

  • session (interact): Persistent session id; reuses browser across calls

  • screenshot (interact): Capture post-interaction screenshot

  • format: Output format -- "markdown" (default), "text", "html"

  • depth: Crawl depth (default: 2, max: 5)

  • max_pages: Max pages for crawl/map (default: 20, max: 100)

  • stealth: Enable anti-bot bypass for protected sites (default: false)

  • schema: JSON Schema dict for extract_structured

Use help tool with tool_name="extract" for full parameter documentation.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
actionYes
urlsNo
pathsNo
depthNo
max_pagesNo
formatNomarkdown
stealthNo
schemaNo
promptNo
queryNo
max_urlsNo
synthesis_modelNo
token_budgetNo
actionsNo
sessionNo
screenshotNo
urlNo

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
resultYes
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations declare readOnlyHint=true and openWorldHint=true. The description adds context about anti-bot bypass (stealth), per-domain rate limiting in batch, and crawl depth behavior. It does not contradict annotations. However, it could disclose more about potential side effects (e.g., rate limits on interact sessions) but overall provides good behavioral coverage beyond annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is long but well-structured with headings, bullet points, and examples. It front-loads the primary purpose and action list. Some redundancy (e.g., repeated 'example:' patterns) could be trimmed, but the organization aids readability and scanning. It is appropriately sized for the tool's complexity.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given 17 parameters and 8+ actions, the description covers major actions and their parameter dependencies. It references the `help` tool for full documentation, acknowledging its own limits. An output schema exists, so return value explanation is not required. Missing detailed handling of some parameters (e.g., prompt, format) but overall completes the picture for typical use cases.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema coverage is 0%, so the description must compensate. It explains required parameters per action (e.g., urls, paths, query, actions) and describes key optional parameters like depth, max_pages, stealth. It clarifies defaults and constraints (e.g., max_urls hard cap 20). Not all parameters are covered (e.g., prompt, format) but the description adds significant meaning for most critical parameters.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's primary function: 'Read and return full page content from URLs or local files.' It then enumerates distinct actions (extract, batch, crawl, map, convert, etc.), each with specific verbs and resources, and contrasts with the `search` sibling tool for finding URLs. This provides excellent differentiation.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicit when-to-use and when-not guidance is provided: 'Use this when you have a specific URL and need its content. For finding URLs first, use the `search` tool instead.' Each action includes example usage scenarios and parameter requirements, offering clear decision support.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/n24q02m/wet-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server