Scrape website content from a URL, save it to cloud storage, and automatically create embeddings for AI applications.
101,611 tools. Last updated 2026-04-09 12:06
- Discover all indexed URLs on a website to identify pages for scraping or locate specific content when scrape results are incomplete.MIT
- Create documents in Pickaxe knowledge bases by adding raw text content or scraping website URLs to build AI agent resources.MIT
- Perform real-time web searches and scrape content from URLs using AI-powered search. Configure result counts and crawl modes to retrieve relevant website information.MIT
- Generate a standardized LLMs.txt file for any URL to define how large language models should interact with the website content.MIT
- Discover all indexed URLs on a website to identify pages for scraping or locate specific sections before content extraction.MIT
Matching MCP Servers
- AsecurityAlicense-qualityAn AI recipe recommendation server based on the MCP protocol, providing functions such as recipe query, classification filtering, intelligent dietary planning, and daily menu recommendation.Last updated 3 months ago51Apache 2.0
- AsecurityFlicense-qualityFetches website content and converts it to Markdown format with AI-powered content cleanup, ad removal, and full OpenAPI/Swagger specification support for easy processing by AI assistants.Last updated 9 months ago492
Matching MCP Connectors
Write better IR reports, improve security writing, and plan cybersecurity product strategy.
MCP server for social media and content data including social profiles, engagement metrics, content trends, and influencer analytics for AI agents.