Skip to main content
Glama

Several results from one page visit

scrape_url
Idempotent

Exposes POST /scrape. Runs any subset of the other operations in one request, served from a single page visit where possible. Each operation is billed and stored exactly as the individual call would be, so this is not a discount — with one exception, and it is the reason to use it: a residential exit is charged per page VISIT, so several results off one visit pay the surcharge once.

Answers with one object keyed by operation, each entry carrying its own success and result, so a partial failure still returns everything that worked.

lighthouse does not share the visit — it runs its own audit on its own engine — so including it means two page fetches, and two surcharges when residential is on. So does a screenshot whose screenshot_options set viewport_width, viewport_height, device_scale_factor, dark_mode or block_ads: those change how the page loads, so the screenshot gets a visit of its own.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
urlYesThe page to fetch. Must be a public http(s) URL.
syncNoWait for the result and return it (default false). When false the call returns a token immediately and you collect the result with get_result.
deviceNoLighthouse only, when it is among the operations. Default mobile.
fieldsNoextract only, and required when it is among the operations: the fields to fill, exactly as extract_data takes them.
labelsNoYour own keys to find this request by later, e.g. {"client": "acme"}: they come back with the result, in the webhook and in list_requests, which can filter by them. Up to 16 keys of up to 40 letters, digits, _ - or .; string values up to 256 characters.
max_ageNoHow fresh a stored result must be to be reused, e.g. "2 hours" or "3 days". Default 7 days, maximum 30. A reused result is free. Pass "0" to force a fresh fetch.
report_toNoAsync only: a webhook URL to deliver the result to. Defaults to the project's configured endpoint, if it has one.
operationsYesWhich operations to run off this page.
project_idYesWhich project this request belongs to. From list_projects.
pdf_optionsNoPDF only, when it is among the operations: how to print it, exactly as capture_pdf takes it.
residentialNoFetch the page from a residential (home ISP) exit instead of a datacentre one. Costs a surcharge per page visit — see get_usage. Use it for sites that block datacentre traffic.
instructionsNoOptional guidance that applies to every field, e.g. "prices in EUR".
page_optionsNoWhat to do to the page before anything is read off it. Applies to the result itself: removed ads and banners are gone from html, markdown and summaries too, and what scrolling loaded is in all of them.
include_auditsNoLighthouse only: include the full per-audit detail. Default false.
idempotency_keyNoMakes the call safe to retry: sending it again with the same key within 24 hours returns the first call's token and result instead of starting (and charging for) new work, even with max_age "0". Up to 255 printable ASCII characters; a UUID is ideal.
screenshot_optionsNoScreenshot only, when it is among the operations: how to take it, exactly as capture_screenshot takes it.

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed2 schema fields changed
    • changedInput schema / properties / page_options / description
      Previous value: -"What to do to the page before anything is read off it. Applies to the result itself: removed ads and banners are gone from html, markdown and summaries too."New value: +"What to do to the page before anything is read off it. Applies to the result itself: removed ads and banners are gone from html, markdown and summaries too, and what scrolling loaded is in all of them."
    • addedInput schema / properties / page_options / properties / scroll_to_bottom
      Added value: +{
      +  "description": "Scroll down the page before reading it, for as long as scrolling loads more (up to 25s). For listings and feeds that load their content as they are scrolled.",
      +  "type": "boolean"
      +}
  2. Changed5 schema fields changed
    • addedInput schema / properties / fields
      Added value: +{
      +  "description": "extract only, and required when it is among the operations: the fields to fill, exactly as extract_data takes them.",
      +  "items": {
      +    "properties": {
      +      "description": {
      +        "description": "What to take from the page. The more specific, the better.",
      +        "type": "string"
      +      },
      +      "fields": {
      +        "description": "For an object: its fields, shaped like this one.",
      +        "items": {
      +          "type": "object"
      +        },
      +        "type": "array"
      +      },
      +      "items": {
      +        "anyOf": [
      +          {
      +            "type": "string"
      +          },
      +          {
      +            "type": "object"
      +          }
      +        ],
      +        "description": "For an array: what it holds — a type such as \"string\", or {\"type\": \"object\", \"fields\": [...]}."
      +      },
      +      "name": {
      +        "description": "The key in the result: letters, digits and underscores.",
      +        "type": "string"
      +      },
      +      "type": {
      +        "enum": [
      +          "string",
      +          "number",
      +          "integer",
      +          "boolean",
      +          "date",
      +          "datetime",
      +          "url",
      +          "email",
      +          "object",
      +          "array"
      +        ],
      +        "type": "string"
      +      }
      +    },
      +    "required": [
      +      "name",
      +      "type"
      +    ],
      +    "type": "object"
      +  },
      +  "type": "array"
      +}
    • addedInput schema / properties / instructions
      Added value: +{
      +  "description": "Optional guidance that applies to every field, e.g. \"prices in EUR\".",
      +  "type": "string"
      +}
    • changedInput schema / properties / operations / items / enum
      Previous value: -[
      -  "html",
      -  "screenshot",
      -  "markdown",
      -  "meta",
      -  "summarize",
      -  "keywords",
      -  "lighthouse",
      -  "console"
      -]New value: +[
      +  "html",
      +  "screenshot",
      +  "markdown",
      +  "meta",
      +  "summarize",
      +  "keywords",
      +  "lighthouse",
      +  "console",
      +  "technologies",
      +  "pdf",
      +  "extract"
      +]
    • addedInput schema / properties / page_options / properties / block_popups
      Added value: +{
      +  "description": "Remove newsletter, app-install and promotional popups laid over the page.",
      +  "type": "boolean"
      +}
    • addedInput schema / properties / pdf_options
      Added value: +{
      +  "description": "PDF only, when it is among the operations: how to print it, exactly as capture_pdf takes it.",
      +  "properties": {
      +    "landscape": {
      +      "description": "Landscape orientation. Default false.",
      +      "type": "boolean"
      +    },
      +    "margin": {
      +      "description": "Margin on every side, 0 to 50 mm. Default 10.",
      +      "type": "integer"
      +    },
      +    "media": {
      +      "description": "print (default) uses the page's print stylesheet; screen prints it as a browser shows it.",
      +      "enum": [
      +        "print",
      +        "screen"
      +      ],
      +      "type": "string"
      +    },
      +    "paper_size": {
      +      "description": "The paper. Default a4.",
      +      "enum": [
      +        "letter",
      +        "legal",
      +        "tabloid",
      +        "a3",
      +        "a4",
      +        "a5"
      +      ],
      +      "type": "string"
      +    },
      +    "print_background": {
      +      "description": "Print background colours and images. Default true.",
      +      "type": "boolean"
      +    },
      +    "scale": {
      +      "description": "Scale of the page, 10 to 200 percent. Default 100.",
      +      "type": "integer"
      +    },
      +    "single_page": {
      +      "description": "One page as wide as the browser window and as tall as the whole document, instead of paper-sized sheets. Default false.",
      +      "type": "boolean"
      +    }
      +  },
      +  "type": "object"
      +}
  3. Changed1 schema field changed
    • changedOutput schema / anyOf
      Previous value: -[
      -  {
      -    "properties": {
      -      "operations": {
      -        "additionalProperties": {
      -          "properties": {
      -            "cached": {
      -              "type": "boolean"
      -            },
      -            "error": {
      -              "type": "string"
      -            },
      -            "result": {},
      -            "success": {
      -              "type": "boolean"
      -            }
      -          },
      -          "type": "object"
      -        },
      -        "description": "One key per operation requested, in the order asked for.",
      -        "type": "object"
      -      },
      -      "url": {
      -        "type": "string"
      -      }
      -    },
      -    "type": "object"
      -  },
      -  {
      -    "properties": {
      -      "labels": {
      -        "type": "object"
      -      },
      -      "status": {
      -        "const": "accepted",
      -        "type": "string"
      -      },
      -      "token": {
      -        "type": "string"
      -      }
      -    },
      -    "required": [
      -      "token",
      -      "status"
      -    ],
      -    "type": "object"
      -  }
      -]New value: +[
      +  {
      +    "properties": {
      +      "final_url": {
      +        "description": "The address the page ended on, after its redirects.",
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "operations": {
      +        "additionalProperties": {
      +          "properties": {
      +            "cached": {
      +              "type": "boolean"
      +            },
      +            "error": {
      +              "type": "string"
      +            },
      +            "result": {},
      +            "success": {
      +              "type": "boolean"
      +            }
      +          },
      +          "type": "object"
      +        },
      +        "description": "One key per operation requested, in the order asked for.",
      +        "type": "object"
      +      },
      +      "url": {
      +        "type": "string"
      +      }
      +    },
      +    "type": "object"
      +  },
      +  {
      +    "properties": {
      +      "labels": {
      +        "type": "object"
      +      },
      +      "status": {
      +        "const": "accepted",
      +        "type": "string"
      +      },
      +      "token": {
      +        "type": "string"
      +      }
      +    },
      +    "required": [
      +      "token",
      +      "status"
      +    ],
      +    "type": "object"
      +  }
      +]
  4. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "$schema": "https://json-schema.org/draft/2020-12/schema",
      +  "anyOf": [
      +    {
      +      "properties": {
      +        "operations": {
      +          "additionalProperties": {
      +            "properties": {
      +              "cached": {
      +                "type": "boolean"
      +              },
      +              "error": {
      +                "type": "string"
      +              },
      +              "result": {},
      +              "success": {
      +                "type": "boolean"
      +              }
      +            },
      +            "type": "object"
      +          },
      +          "description": "One key per operation requested, in the order asked for.",
      +          "type": "object"
      +        },
      +        "url": {
      +          "type": "string"
      +        }
      +      },
      +      "type": "object"
      +    },
      +    {
      +      "properties": {
      +        "labels": {
      +          "type": "object"
      +        },
      +        "status": {
      +          "const": "accepted",
      +          "type": "string"
      +        },
      +        "token": {
      +          "type": "string"
      +        }
      +      },
      +      "required": [
      +        "token",
      +        "status"
      +      ],
      +      "type": "object"
      +    }
      +  ],
      +  "type": "object"
      +}
  5. First observed

TDQS

Score is being calculated.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources