scrape_url

scrape_url

Extract structured content from any URL with customizable options like ad blocking, mobile emulation, and include/exclude tags. Retrieve data in formats like markdown, HTML, or JSON using Firecrawl API.

Instructions

Scrape content from a URL using Firecrawl API

Input Schema

Name	Required	Description
`blockAds`	No	Enable ad/cookie popup blocking
`excludeTags`	No	Tags to exclude from output
`formats`	No	Output formats
`includeTags`	No	Tags to include in output
`jsonOptions`	No
`location`	No
`mobile`	No	Emulate mobile device
`onlyMainContent`	No	Only return main content excluding headers, navs, footers
`url`	Yes	URL to scrape
`waitFor`	No	Delay in milliseconds before fetching content

Input Schema (JSON Schema)

{
  "properties": {
    "blockAds": {
      "default": true,
      "description": "Enable ad/cookie popup blocking",
      "type": "boolean"
    },
    "excludeTags": {
      "description": "Tags to exclude from output",
      "items": {
        "type": "string"
      },
      "type": "array"
    },
    "formats": {
      "description": "Output formats",
      "items": {
        "enum": [
          "markdown",
          "html",
          "rawHtml",
          "links",
          "screenshot",
          "screenshot@fullPage",
          "json"
        ],
        "type": "string"
      },
      "type": "array"
    },
    "includeTags": {
      "description": "Tags to include in output",
      "items": {
        "type": "string"
      },
      "type": "array"
    },
    "jsonOptions": {
      "properties": {
        "prompt": {
          "description": "Prompt for extracting specific information",
          "type": "string"
        },
        "schema": {
          "description": "Schema for extraction",
          "type": "object"
        },
        "systemPrompt": {
          "description": "System prompt for extraction",
          "type": "string"
        }
      },
      "type": "object"
    },
    "location": {
      "properties": {
        "country": {
          "description": "ISO 3166-1 alpha-2 country code",
          "type": "string"
        },
        "languages": {
          "description": "Preferred languages/locales",
          "items": {
            "type": "string"
          },
          "type": "array"
        }
      },
      "type": "object"
    },
    "mobile": {
      "default": false,
      "description": "Emulate mobile device",
      "type": "boolean"
    },
    "onlyMainContent": {
      "default": true,
      "description": "Only return main content excluding headers, navs, footers",
      "type": "boolean"
    },
    "url": {
      "description": "URL to scrape",
      "type": "string"
    },
    "waitFor": {
      "default": 0,
      "description": "Delay in milliseconds before fetching content",
      "type": "number"
    }
  },
  "required": [
    "url"
  ],
  "type": "object"
}

MCP Server Firecrawl

Instructions

Input Schema

Input Schema (JSON Schema)

Other Tools from MCP Server Firecrawl

Related Tools