Spider MCP

MIT License

Overview InspectNew Schema Related Servers Reviews Score

batch_webpage_scrape

Extract data from multiple webpages concurrently with support for up to 20 URLs and configurable concurrency settings using crawler technology.

Instructions

Batch scrape multiple webpages with concurrent processing support.

Input Schema

Name	Required	Description	Default
`maxConcurrent`	No	Maximum concurrency
`urls`	Yes	List of webpage URLs to scrape, up to 20.

Input Schema (JSON Schema)

{
  "properties": {
    "maxConcurrent": {
      "default": 3,
      "description": "Maximum concurrency",
      "maximum": 10,
      "minimum": 1,
      "type": "number"
    },
    "urls": {
      "description": "List of webpage URLs to scrape, up to 20.",
      "items": {
        "type": "string"
      },
      "maxItems": 20,
      "minItems": 1,
      "type": "array"
    }
  },
  "required": [
    "urls"
  ],
  "type": "object"
}

Install Server

HTTP connection URL

Other Tools from Spider MCP

Related Tools

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Bosegluon2/spider-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server