Skip to main content
Glama

Extract web page

extract_url
Read-only

Fetch a public web page (robots.txt respected) and return clean Markdown plus fixed-schema JSON: article metadata, product/price, tables. HTML only, no JS execution, no PDF. Free 20 calls/day per IP; pass 'Authorization: Bearer ' for prepaid credits.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "url": "<url>"
    },
    "name": "extract_url"
  }
}

Input Schema

NameRequiredDescriptionDefault
urlYesPublic http(s) URL

Output Schema

NameRequiredDescriptionDefault
urlYes
tablesYes
productYes
markdownYes
metadataYes
final_urlYes
fetched_atYes
word_countNo
content_sourceNoWhere the content came from: raw_html = the HTTP response body, no JavaScript executed (current behaviour); rendered = after headless rendering (not offered yet)
schema_versionYes
markdown_truncatedNo
product_unresolvedNoOnly when product is null: why no product was extracted (e.g. listing_page)

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed5 schema fields changed
    • addedOutput schema / properties / content_source
      Added value: +{
      +  "description": "Where the content came from: raw_html = the HTTP response body, no JavaScript executed (current behaviour); rendered = after headless rendering (not offered yet)",
      +  "enum": [
      +    "raw_html",
      +    "rendered"
      +  ],
      +  "type": "string"
      +}
    • addedOutput schema / properties / product / properties / price_detail
      Added value: +{
      +  "description": "Preferred price field. Never contains 0. status=unresolved always comes with unresolved.reason.",
      +  "properties": {
      +    "currency": {
      +      "type": [
      +        "string",
      +        "null"
      +      ]
      +    },
      +    "currency_basis": {
      +      "enum": [
      +        "declared",
      +        "symbol",
      +        null
      +      ],
      +      "type": [
      +        "string",
      +        "null"
      +      ]
      +    },
      +    "prices": {
      +      "items": {
      +        "properties": {
      +          "amount": {
      +            "exclusiveMinimum": 0,
      +            "type": "number"
      +          },
      +          "amount_high": {
      +            "type": [
      +              "number",
      +              "null"
      +            ]
      +          },
      +          "currency": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "evidence": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "installment": {
      +            "type": [
      +              "object",
      +              "null"
      +            ]
      +          },
      +          "method": {
      +            "enum": [
      +              "json-ld",
      +              "opengraph",
      +              "microdata",
      +              "heuristic",
      +              "dom",
      +              "shopify_meta"
      +            ],
      +            "type": "string"
      +          },
      +          "type": {
      +            "description": "current = the only price shown, no discount information; sale = current price with a higher list price on the page",
      +            "enum": [
      +              "list",
      +              "sale",
      +              "installment",
      +              "current"
      +            ],
      +            "type": "string"
      +          },
      +          "variant": {
      +            "properties": {
      +              "attributes": {
      +                "type": [
      +                  "object",
      +                  "null"
      +                ]
      +              },
      +              "id": {
      +                "type": [
      +                  "string",
      +                  "null"
      +                ]
      +              },
      +              "match": {
      +                "enum": [
      +                  "offer_url",
      +                  "offer_sku",
      +                  "shopify_variant_id",
      +                  "url_param+dom_selected",
      +                  "dom_selected"
      +                ],
      +                "type": "string"
      +              },
      +              "name": {
      +                "type": [
      +                  "string",
      +                  "null"
      +                ]
      +              },
      +              "sku": {
      +                "type": [
      +                  "string",
      +                  "null"
      +                ]
      +              },
      +              "url": {
      +                "type": [
      +                  "string",
      +                  "null"
      +                ]
      +              }
      +            },
      +            "type": [
      +              "object",
      +              "null"
      +            ]
      +          }
      +        },
      +        "required": [
      +          "type",
      +          "amount",
      +          "currency"
      +        ],
      +        "type": "object"
      +      },
      +      "type": "array"
      +    },
      +    "range": {
      +      "properties": {
      +        "basis": {
      +          "enum": [
      +            "aggregate_offer",
      +            "offers",
      +            "product_group_variants"
      +          ],
      +          "type": "string"
      +        },
      +        "currency": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "high": {
      +          "type": [
      +            "number",
      +            "null"
      +          ]
      +        },
      +        "low": {
      +          "type": "number"
      +        },
      +        "offer_count": {
      +          "type": [
      +            "integer",
      +            "null"
      +          ]
      +        }
      +      },
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "selected_variant": {
      +      "properties": {
      +        "attributes": {
      +          "type": [
      +            "object",
      +            "null"
      +          ]
      +        },
      +        "id": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "match": {
      +          "enum": [
      +            "offer_url",
      +            "offer_sku",
      +            "shopify_variant_id",
      +            "url_param+dom_selected",
      +            "dom_selected"
      +          ],
      +          "type": "string"
      +        },
      +        "name": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "sku": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "url": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        }
      +      },
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "status": {
      +      "enum": [
      +        "resolved",
      +        "partial",
      +        "unresolved"
      +      ],
      +      "type": "string"
      +    },
      +    "unresolved": {
      +      "properties": {
      +        "detail": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "reason": {
      +          "enum": [
      +            "no_offer_in_structured_data",
      +            "price_not_numeric",
      +            "zero_price",
      +            "js_rendered_suspected",
      +            "template_placeholder",
      +            "no_price_found",
      +            "variant_not_matched",
      +            "listing_page",
      +            "no_product_markup",
      +            "not_html"
      +          ],
      +          "type": "string"
      +        }
      +      },
      +      "required": [
      +        "reason"
      +      ],
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "variants": {
      +      "items": {
      +        "properties": {
      +          "amount": {
      +            "type": [
      +              "number",
      +              "null"
      +            ]
      +          },
      +          "attributes": {
      +            "type": [
      +              "object",
      +              "null"
      +            ]
      +          },
      +          "availability": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "currency": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "evidence": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "id": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "name": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "sku": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "source": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "url": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          }
      +        },
      +        "type": "object"
      +      },
      +      "maxItems": 100,
      +      "type": "array"
      +    },
      +    "warnings": {
      +      "items": {
      +        "type": "string"
      +      },
      +      "type": "array"
      +    }
      +  },
      +  "required": [
      +    "status",
      +    "prices"
      +  ],
      +  "type": "object"
      +}
    • addedOutput schema / properties / product / properties / source / description
      Added value: +"Extraction method for the flat fields (not the content source; see content_source)"
    • addedOutput schema / properties / product / properties / source / enum
      Added value: +[
      +  "json-ld",
      +  "opengraph",
      +  "microdata",
      +  "heuristic",
      +  null
      +]
    • addedOutput schema / properties / product_unresolved
      Added value: +{
      +  "description": "Only when product is null: why no product was extracted (e.g. listing_page)",
      +  "properties": {
      +    "detail": {
      +      "type": [
      +        "string",
      +        "null"
      +      ]
      +    },
      +    "reason": {
      +      "enum": [
      +        "no_offer_in_structured_data",
      +        "price_not_numeric",
      +        "zero_price",
      +        "js_rendered_suspected",
      +        "template_placeholder",
      +        "no_price_found",
      +        "variant_not_matched",
      +        "listing_page",
      +        "no_product_markup",
      +        "not_html"
      +      ],
      +      "type": "string"
      +    }
      +  },
      +  "required": [
      +    "reason"
      +  ],
      +  "type": [
      +    "object",
      +    "null"
      +  ]
      +}
  2. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "properties": {
      +    "fetched_at": {
      +      "type": "string"
      +    },
      +    "final_url": {
      +      "type": "string"
      +    },
      +    "markdown": {
      +      "type": "string"
      +    },
      +    "markdown_truncated": {
      +      "type": "boolean"
      +    },
      +    "metadata": {
      +      "properties": {
      +        "authors": {
      +          "items": {
      +            "type": "string"
      +          },
      +          "type": "array"
      +        },
      +        "canonical_url": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "description": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "image": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "language": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "modified_at": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "published_at": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "site_name": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "title": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "type": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        }
      +      },
      +      "type": "object"
      +    },
      +    "product": {
      +      "properties": {
      +        "availability": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "brand": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "currency": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "description": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "gtin": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "image": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "name": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "price": {
      +          "type": [
      +            "number",
      +            "null"
      +          ]
      +        },
      +        "price_high": {
      +          "type": [
      +            "number",
      +            "null"
      +          ]
      +        },
      +        "rating": {
      +          "type": [
      +            "object",
      +            "null"
      +          ]
      +        },
      +        "sku": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        },
      +        "source": {
      +          "type": [
      +            "string",
      +            "null"
      +          ]
      +        }
      +      },
      +      "type": [
      +        "object",
      +        "null"
      +      ]
      +    },
      +    "schema_version": {
      +      "type": "string"
      +    },
      +    "tables": {
      +      "items": {
      +        "properties": {
      +          "caption": {
      +            "type": [
      +              "string",
      +              "null"
      +            ]
      +          },
      +          "checks": {
      +            "properties": {
      +              "column_count": {
      +                "type": "integer"
      +              },
      +              "consistent_width": {
      +                "type": "boolean"
      +              },
      +              "row_count": {
      +                "type": "integer"
      +              }
      +            },
      +            "type": "object"
      +          },
      +          "headers": {
      +            "items": {
      +              "type": "string"
      +            },
      +            "type": "array"
      +          },
      +          "index": {
      +            "type": "integer"
      +          },
      +          "rows": {
      +            "items": {
      +              "items": {
      +                "type": "string"
      +              },
      +              "type": "array"
      +            },
      +            "type": "array"
      +          }
      +        },
      +        "type": "object"
      +      },
      +      "type": "array"
      +    },
      +    "url": {
      +      "type": "string"
      +    },
      +    "word_count": {
      +      "type": "integer"
      +    }
      +  },
      +  "required": [
      +    "url",
      +    "final_url",
      +    "fetched_at",
      +    "schema_version",
      +    "markdown",
      +    "metadata",
      +    "product",
      +    "tables"
      +  ],
      +  "type": "object"
      +}
  3. First observed

TDQS

A4.1/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the annotations, the description discloses that robots.txt is respected, JS and PDF are unsupported, output includes Markdown and fixed-schema JSON, and there is a free tier of 20 calls/day per IP with optional bearer-token prepaid credits. These are exactly the behavioral details an agent needs and they are not contradicted by the read-only/open-world annotations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single compact passage that front-loads the core action, then layers in output format, limitations, quota, and auth. Every clause carries actionable information and there is no filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given a simple one-parameter external-fetch tool with annotations and an output schema, the description covers capabilities, return mix, technical exclusions, rate limits, and authentication. Nothing essential for correct invocation is missing.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

There is only one parameter, and its schema description fully covers it as a public http(s) URL. The description reinforces 'public web page' but adds no parameter-specific meaning beyond the schema, so the baseline of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb and resource: fetch a public web page and return Markdown plus fixed-schema JSON including article metadata, product/price, and tables. This is much more than a title restatement. It does not explicitly distinguish itself from the sibling page_markdown, which keeps it from a 5.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives useful constraints—HTML only, no JS execution, no PDF, robots.txt respected—that implicitly define when the tool applies. However, it never states when to prefer this tool over page_markdown or any alternative, so usage guidance is implied rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.