WebSearch

Overview InspectNew Schema Related Servers Reviews Score

crawl

Extract website content by crawling from a specified URL, limiting depth and page count. Outputs data in markdown and HTML for analysis or processing.

Instructions

Crawls a website starting from the specified URL and extracts content from multiple pages. Args: - url: The complete URL of the web page to start crawling from - maxDepth: The maximum depth level for crawling linked pages - limit: The maximum number of pages to crawl

Returns:
- Content extracted from the crawled pages in markdown and HTML format

Input Schema

Name	Required	Description	Default
`limit`	Yes
`maxDepth`	Yes
`url`	Yes

Input Schema (JSON Schema)

{
  "properties": {
    "limit": {
      "title": "Limit",
      "type": "integer"
    },
    "maxDepth": {
      "title": "Maxdepth",
      "type": "integer"
    },
    "url": {
      "title": "Url",
      "type": "string"
    }
  },
  "required": [
    "url",
    "maxDepth",
    "limit"
  ],
  "title": "crawlArguments",
  "type": "object"
}

You must be authenticated.

Other Tools from WebSearch

Related Tools

read_webpage
@adenot/mcp-google-search
firecrawl_scrape_process
@spences10/mcp-omnisearch
scrapeDeep
@pinkpixel-dev/prysm-mcp-server
scrapeWebContent
@NaniDAO/agentek
firecrawl_scrape
@mendableai/firecrawl-mcp-server

ID: bpr128ue6j