Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
MCP_HOSTNoHost untuk Streamable HTTP127.0.0.1
MCP_PORTNoPort untuk Streamable HTTP8000
LLM_MODELNoModel LLM yang digunakan
LLM_API_KEYNoAPI key untuk LLM
SEARXNG_URLNoURL SearXNG serverhttp://localhost:8080
LLM_BASE_URLNoBase URL untuk LLM endpoint
MCP_TRANSPORTNoTransport MCP (stdio atau streamable-http)stdio
ARACHNE_PROXY_URLNoProxy HTTP/HTTPS opsional
ARACHNE_MAX_REQUESTSNoBatas maksimum request per crawl200
BRAVE_SEARCH_API_KEYNoAPI key untuk Brave Search
ARACHNE_RESPECT_ROBOTSNoMematuhi robots.txttrue
ARACHNE_MAX_TOTAL_CHARSNoBatas output agregat250000
ARACHNE_CACHE_TTL_SECONDSNoTTL cache3600
ARACHNE_ALLOW_BROWSER_EVALNoMengizinkan arbitrary browser JSfalse
ARACHNE_ALLOW_IGNORE_ROBOTSNoMengizinkan caller memilih respect_robots=falsefalse
ARACHNE_BROWSER_CONCURRENCYNoJumlah context Chromium bersamaan2
ARACHNE_BLOCK_PRIVATE_NETWORKSNoProteksi SSRFtrue

Capabilities

Features and capabilities supported by this server

CapabilityDetails
tools
{
  "listChanged": false
}
prompts
{
  "listChanged": false
}
resources
{
  "subscribe": false,
  "listChanged": false
}
experimental
{}

Tools

Functions exposed to the LLM to take actions

NameDescription
healthA

Return enabled engines, integrations, security policy, and parser availability.

crawl_urlB

Fetch and extract one URL using fast HTTP, browser rendering, or automatic escalation.

Supports HTML, text, JSON, XML, PDF, DOCX, XLSX, CSV and TSV. Content returned to an agent is marked as untrusted and scanned for common prompt-injection text.

parse_urlC

Parse a remote document or non-HTML resource into LLM-ready text/Markdown.

crawl_siteB

Crawl a site with strict request/error/token budgets and per-host rate limiting.

map_siteC

Discover site URLs from recursive sitemaps plus optional shallow crawling.

extract_linksC

Extract normalized crawlable links from static or JavaScript-rendered pages.

check_robotsC

Inspect robots.txt permissions, crawl delay, request rate, and sitemap declarations.

browser_interactA

Operate a browser using safe declarative actions: click, fill, press, select, wait, scroll, and goto.

JavaScript evaluate is disabled unless the server owner explicitly enables it. This tool does not bypass CAPTCHA, authentication, paywalls, or access controls.

batch_scrapeA

Scrape up to 500 URLs concurrently with a shared output budget.

search_webC

Search through a configured self-hosted SearXNG or Brave Search provider.

extract_structuredC

Extract JSON matching a caller-supplied schema through an optional OpenAI-compatible LLM.

crawl_diffB

Compare a page with its previous persistent snapshot and return a unified diff.

chunk_contentB

Split long content into stable, overlapping, hash-addressed chunks for RAG or agents.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Rizky742/crawl-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server