Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| FREECRAWL_CACHE | No | Enable caching | true |
| FREECRAWL_API_KEYS | No | Comma-separated list of valid API keys | |
| FREECRAWL_HEADLESS | No | Run browsers in headless mode | true |
| FREECRAWL_CACHE_DIR | No | Cache directory path | /tmp/freecrawl_cache |
| FREECRAWL_CACHE_TTL | No | Cache time-to-live in seconds | 3600 |
| FREECRAWL_LOG_LEVEL | No | Logging level (ERROR, WARNING, INFO, DEBUG) | INFO |
| FREECRAWL_ROTATE_UA | No | Enable user agent rotation | true |
| FREECRAWL_TRANSPORT | No | Transport mode (stdio for MCP, http for REST API) | stdio |
| FREECRAWL_CACHE_SIZE | No | Cache size limit in bytes (512MB) | 536870912 |
| FREECRAWL_RATE_LIMIT | No | Rate limit in requests per minute | 60 |
| FREECRAWL_ANTI_DETECT | No | Enable anti-detection measures | true |
| FREECRAWL_MAX_BROWSERS | No | Maximum number of browser instances in the pool | 3 |
| FREECRAWL_MAX_CONCURRENT | No | Maximum number of concurrent requests | 10 |
| FREECRAWL_MAX_PER_DOMAIN | No | Maximum concurrent requests per domain | 3 |
| FREECRAWL_BLOCKED_DOMAINS | No | Comma-separated list of blocked domains | localhost,127.0.0.1 |
| FREECRAWL_REQUIRE_API_KEY | No | Require API key authentication | false |
Schema
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
No tools | |