Python Crawling MCP
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| EXAMPLE_PASSWORD | No | Example password for the example login adapter. Only needed when using the example-reader auth profile. | |
| EXAMPLE_USERNAME | No | Example username for the example login adapter. Only needed when using the example-reader auth profile. | |
| CRAWLING_MCP_MAX_CONTENT_BYTES | No | Maximum allowed response content size in bytes. If the response HTML exceeds this limit, parsing and extraction are stopped. | |
| CRAWLING_MCP_ALLOW_PRIVATE_NETWORKS | No | Whether to allow crawling private network addresses. Default is false for production. Set to true only for local integration tests or isolated test Compose. | false |
Capabilities
Server capabilities have not been inspected yet.
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/BaektotheFuture98/Crawl_MCP'
If you have feedback or need assistance with the MCP directory API, please join our Discord server