Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| OLLAMA_HOST | No | Ollama URL for local LLM features | http://localhost:11434 |
| WEBCLAW_PROXY | No | Single proxy URL | |
| OPENAI_API_KEY | No | OpenAI API key for LLM features | |
| WEBCLAW_API_KEY | No | Cloud API key (enables bot bypass, JS rendering, search, and research tools) | |
| ANTHROPIC_API_KEY | No | Anthropic API key for LLM features | |
| WEBCLAW_PROXY_FILE | No | Path to proxy pool file |
Capabilities
Features and capabilities supported by this server
| Capability | Details |
|---|---|
| tools | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| batch | Extract content from multiple URLs concurrently. |
| brand | Extract brand identity (colors, fonts, logo, favicon) from a website's HTML and CSS. Automatically falls back to the webclaw cloud API when bot protection is detected. |
| crawl | Crawl a website starting from a seed URL, following links breadth-first up to a configurable depth and page limit. |
| diff | Compare the current content of a URL against a previous extraction snapshot, showing what changed. Automatically falls back to the webclaw cloud API when bot protection is detected. |
| extract | Extract structured data from a web page using an LLM. Provide either a JSON schema or a natural language prompt. Automatically falls back to the webclaw cloud API when bot protection is detected. |
| map | Discover URLs from a website's sitemaps (robots.txt + sitemap.xml). |
| research | Run a deep research investigation on a topic or question. Requires WEBCLAW_API_KEY. Starts an async research job on the webclaw cloud API, then polls until complete. |
| scrape | Scrape a single URL and extract its content as markdown, LLM-optimized text, plain text, or full JSON. Automatically falls back to the webclaw cloud API when bot protection or JS rendering is detected. |
| search | Search the web for a query and return structured results. Requires WEBCLAW_API_KEY. |
| summarize | Summarize the content of a web page using an LLM. Automatically falls back to the webclaw cloud API when bot protection is detected. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |