Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
LITELLM_URLYesBase URL of the LiteLLM proxy (no trailing slash)
LITELLM_API_KEYYesAdmin bearer key (master or admin virtual key)

Instructions

Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.

This server publishes no instructions, or was last inspected before Glama recorded them.

Capabilities

Features and capabilities supported by this server

Protocol revision2025-11-25

CapabilityDetails
tools
{
  "listChanged": false
}
prompts
{
  "listChanged": false
}
resources
{
  "subscribe": false,
  "listChanged": false
}
experimental
{}

Tools

Functions exposed to the LLM to take actions

NameDescription
litellm_versionA

Get the MCP server version and the LiteLLM service readiness.

mcp is this package's version (importlib metadata). service is GET /health/readiness, reporting the proxy's status and database connectivity - on LiteLLM v1.93.0 that payload is {status, db}, with no LiteLLM version field.

litellm_adminA

Proxy-global LiteLLM administration (high risk): proxy-global settings, allowed IPs, global spend reset, bulk user update.

Call with operation="help" to list all available admin operations. Otherwise pass the operation name and a JSON object with parameters.

Example: litellm_admin(operation="AddAllowedIp", params={"ip": "1.2.3.4"})

litellm_deleteB

Delete LiteLLM resources (destructive, irreversible), including cache flushall.

Call with operation="help" to list all available delete operations. Otherwise pass the operation name and a JSON object with parameters.

Example: litellm_delete(operation="DeleteKeys", params={"keys": ["sk-..."]})

litellm_executeA

Execute reversible actions on LiteLLM resources: block/unblock toggles, key regenerate/reset, connection tests, targeted cache delete.

Call with operation="help" to list all available execute operations. Otherwise pass the operation name and a JSON object with parameters.

Example: litellm_execute(operation="BlockKey", params={"key": "sk-..."})

litellm_readA

Query LiteLLM proxy data (safe, read-only): lists, infos, spend/usage, health, settings reads, token/cost utils, MCP gateway registry reads.

Call with operation="help" to list all available read operations. Otherwise pass the operation name and a JSON object with parameters.

Example: litellm_read(operation="ListKeys")

litellm_writeA

Create or update LiteLLM resources (non-destructive): keys, teams, users, orgs, customers, budgets, models, credentials, tags, guardrails, fallbacks, MCP servers/toolsets, access groups.

Call with operation="help" to list all available write operations. Otherwise pass the operation name and a JSON object with parameters.

Example: litellm_write(operation="GenerateKey", params={"team_id": "..."})

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

TDQS

A3.9/5.0

Scored across 6 tools

Disambiguation4/5

The tools are separated into clear action categories (read/write/delete/execute/admin/version), which largely avoids confusion. However, litellm_delete and litellm_execute both involve cache deletion, and litellm_admin overlaps with litellm_write for user updates, creating minor boundary ambiguity.

Naming Consistency4/5

All tools share the consistent 'litellm_' prefix plus a descriptive word, forming a predictable pattern. The pattern is slightly broken by 'litellm_admin' and 'litellm_version', which use nouns rather than verbs, but this is a minor deviation.

Tool Count5/5

Six tools is a well-scoped count for a proxy management server. Each tool represents a broad but coherent category of operations, making the surface area manageable for an agent without being too thin or bloated.

Completeness5/5

The tool set covers version/health, read-only queries, create/update, delete, reversible actions, and global admin operations. This provides comprehensive lifecycle coverage for LiteLLM resources with no obvious dead ends.

Maintenance

ActivityActive
ResponsivenessNo issues