Skip to main content
Glama

Methods for Crawling Data from Websites MCP tools

Production-ready MCP servers that extend AI capabilities through file access, database connections, APIs, and contextual services.

46,506 tools. Last updated 2025-12-23 08:13
  • Extract structured financial data from investor relations websites and online sources using natural language queries. Designed for gathering financial insights from platforms without accessible APIs.
    MIT License
  • Extract parameters from web applications using automated crawling and manual methods to identify input fields for security testing and vulnerability assessment.
  • Enable crawling for a specific document on open-docs-mcp by specifying its name, ensuring it is indexed and accessible for search and retrieval.
  • Crawl and extract content from all accessible subpages of a website with configurable depth limits. Ideal for comprehensive site analysis, content indexing, and efficient data collection from entire domains.
    MIT License
  • Prevent automated crawling of a specific document by specifying its name. Use this feature to control document accessibility in the open-docs-mcp server.
  • Crawl websites for security reconnaissance using advanced spidering with JavaScript execution and form extraction to identify potential vulnerabilities.

Interested in MCP?

Join the MCP community for support and updates.

RedditDiscord

Matching MCP servers