A
license-
qualityD
maintenanceAn MCP server that integrates Crawl4AI with Supabase to enable AI agents to crawl websites, store content in a vector database, and perform RAG queries.
8
MIT
mcp-crawl4ai2vectordb
by utaschulz1
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcp-crawl4ai2vectordbcrawl the FastAPI docs at https://fastapi.tiangolo.com"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
mcp-crawl4ai2vectordb
MCP server for crawling web documentation and storing it in a Supabase vector database. Credits: craw4ai and Cole Medin's mcp server.
Responsibility: ingestion only — crawl, chunk, embed, store. No search, no reranking, no Neo4j.
Tools
Tool | Description |
| Crawl one URL and store its content |
| Auto-detect URL type (sitemap / txt / webpage) and crawl accordingly |
| List all sources stored in the database |
| Delete a source and all its content from the database |
Related MCP server: web-docs-mcp
Setup
cp .env.example .env
# fill in OPENAI_API_KEY, MODEL_CHOICE, SUPABASE_URL, SUPABASE_SERVICE_KEY
uv syncRunning
stdio (recommended — Claude Code manages the process):
Add to your MCP config:
{
"mcpServers": {
"crawl4ai2vectordb": {
"type": "stdio",
"command": "uv",
"args": ["run", "python", "-u", "src/server.py"],
"cwd": "/path/to/mcp_crawl4ai2vectordb"
}
}
}or
{
"mcpServers": {
"crawl4ai2vectordb": {
"type": "sse",
"url": "http://localhost:8051/sse"
}
}
}SSE (manual startup, for multi-client use):
TRANSPORT=sse uv run python -u src/server.pyOptional features
Env var | Default | Effect |
|
| Prepend LLM-generated context to each chunk before embedding (improves retrieval accuracy, costs more) |
|
| Extract code blocks and store them separately in |
This server cannot be installed
Maintenance
–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- Flicense-qualityCmaintenanceMCP server for searching web documentation via sitemap.xml, enabling semantic search across multiple documentation sites using Ollama embeddings.
- Alicense-qualityDmaintenanceA database-agnostic MCP server that integrates web crawling with Retrieval Augmented Generation, supporting multiple AI providers and vector database backends for flexible and intelligent content retrieval.1MIT
- Flicense-qualityDmaintenanceDocumentation crawler MCP server that crawls and indexes documentation sites so that any MCP-compatible AI can search, read, and expand on the content.1
Related MCP Connectors
MCP server for interacting with the Supabase platform
MCP server for AgentDocs (agentdocs.eu): read, search, write, comment on & share Markdown docs.
MCP server for accessing curated awesome list documentation
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/utaschulz1/mcp_crawl4ai2vectordb'
If you have feedback or need assistance with the MCP directory API, please join our Discord server