mcp-crawler
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcp-crawlercrawl the latest blog posts from techcrunch.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
MCP Service
This is a Model Control Protocol (MCP) service that provides tools for Cursor and Claude applications.
Connecting to the Service
For Cursor Users
Open Cursor
Go to Settings > AI > Advanced
Under "MCP Endpoint", enter:
https://your-render-url.onrender.comSave settings and restart Cursor
For Claude App Users
Open Claude App
Go to Settings > Advanced
Under "MCP Connection", enter:
https://your-render-url.onrender.comSave settings
Related MCP server: crawl4ai-mcp
Available Tools
Web Crawler: Crawls web pages and returns content as markdown
Deployment
This service is deployed on Render.com as a Docker container. The service is accessible at:
https://your-render-url.onrender.comReplace your-render-url.onrender.com with the actual URL provided by Render after deployment.
Environment Variables
MCP_HOST: Host to bind the server (default: 0.0.0.0)MCP_PORT: Port to bind the server (default: 8000)
Monitoring
A health endpoint is available at /health for monitoring the service status.
This server cannot be installed
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseAqualityDmaintenanceEnables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.613MIT
- FlicenseBqualityDmaintenanceAn MCP Server for Web scraping and Crawling, built using Crawl4AI224
- MIT
- -license-quality-maintenanceEnables querying and retrieving content from webpages by parsing sitemap.xml files and fetching HTML content from specified URLs. Includes built-in rate limiting for protection against abuse.
Related MCP Connectors
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
Scrape, crawl, map and extract the web. Pay per call in USDC, no account or API key.
Spot pre-launch products before they trend. Search the web and tech sites, extract and parse pages…
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/orange-fruit01/MCP-Test-Run'
If you have feedback or need assistance with the MCP directory API, please join our Discord server