Skip to main content
Glama
AbhishekMore-1

LiteLLM MCP Server Bridge

LiteLLM MCP Server Bridge

A Model Context Protocol (MCP) server that connects Antigravity to your deployed LiteLLM instance.

Features

This MCP server provides the following tools:

  • chat_completion - Generate chat completions using any model in your LiteLLM instance

  • completion - Generate text completions using the legacy endpoint

  • list_models - List all available models

  • health_check - Check LiteLLM instance health status

  • create_embedding - Generate embeddings

  • model_info - Get detailed information about a specific model

  • create_image - Generate images using models available in your instance

  • create_speech - Generate speech audio from text (TTS)

  • rerank - Rerank documents based on a search query

  • key_generate - Generate a new LiteLLM Proxy API key (admin feature)

  • key_info - Get details and spend info for a LiteLLM Proxy API key (admin feature)

Related MCP server: A2A Client MCP Server

Setup

1. Configure Antigravity

Add the following to your Antigravity MCP configuration. This will use npx to fetch and run the latest version of the published package on-the-fly.

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "litellm-mcp-server@latest"
      ],
      "env": {
        "LITELLM_BASE_URL": "https://your-litellm-url",
        "LITELLM_API_KEY": "your-api-key-here"
      }
    }
  }
}

2. Set Your Secrets

Replace your-litellm-url and your-api-key-here in the configuration with your actual LiteLLM Base URL and API key.

Usage Examples

Once configured, you can use the MCP tools in Antigravity:

Chat Completion

Use the chat_completion tool to generate a response using gpt-4

List Models

Use the list_models tool to see what models are available

Health Check

Use the health_check tool to verify the LiteLLM instance is running

Environment Variables

  • LITELLM_BASE_URL - Your LiteLLM instance URL

  • LITELLM_API_KEY - Your LiteLLM API key for authentication

Troubleshooting

Server won't start

  1. Ensure Node.js is installed: node --version

  2. Check dependencies are installed: npm install

  3. Verify the script path in your Antigravity config is correct

  4. Check that your API key is valid

Connection errors

  1. Verify your LiteLLM instance is accessible: curl https://your-litellm-url/health

  2. Check your API key has proper permissions

  3. Ensure your network allows connections to the LiteLLM instance

Tool not showing up

  1. Restart Antigravity after adding the MCP server configuration

  2. Check Antigravity logs for any error messages

  3. Verify the JSON configuration is valid

Architecture

The MCP server acts as a bridge:

Antigravity ←→ MCP Server (this script) ←→ LiteLLM Instance

All requests from Antigravity are forwarded to your LiteLLM instance with proper authentication headers.

License

MIT

Available Tools

11 tools
chat_completionC

Generate chat completions using LiteLLM. Supports all models available in your LiteLLM instance.

ParametersJSON Schema
NameRequiredDescriptionDefault
modelYesThe model to use (e.g., gpt-4, claude-3-opus, etc.)
top_pNoNucleus sampling parameter
streamNoWhether to stream the response
messagesYesArray of message objects with role and content
max_tokensNoMaximum tokens to generate
temperatureNoSampling temperature (0-2)

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

There are no annotations, so the description must carry the burden of behavioral disclosure. It does not mention authentication requirements, rate limits, streaming behavior, whether the operation is read-only or has side effects, or the shape of the response. The only added behavioral detail is model support, which is static compatibility, not operational behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is composed of two short sentences with no extraneous vocabulary. It leads with the primary function and adds a brief note about model compatibility. While concise, it is perhaps too sparse to be fully informative, but this dimension focuses on lack of bloat.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's moderate complexity (six parameters) and absence of annotations or output schema, the description is insufficiently complete. It doesn't explain return values, potential errors, or any operational caveats, leaving the agent to make assumptions. More behavioral context is needed for reliable invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema provides descriptions for all six parameters, achieving 100% coverage. The description itself does not elaborate on any parameter beyond what the schema already states; for instance, 'model' is described in the schema with examples. Thus, the description adds no additional semantic value over the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the action ('Generate chat completions') and the platform ('LiteLLM'), providing a specific verb and resource. However, the presence of a sibling tool named 'completion' without any distinguishing commentary means it does not fully differentiate itself from similar tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description offers no guidance on when to use this tool versus alternatives such as 'completion' or other model interaction tools. No usage scenarios, exclusions, or alternative references are provided, leaving the agent without direction for tool selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

completionB

Generate text completions (legacy endpoint) using LiteLLM.

ParametersJSON Schema
NameRequiredDescriptionDefault
modelYesThe model to use
promptYesThe prompt to generate completions for
streamNoWhether to stream the response
max_tokensNoMaximum tokens to generate
temperatureNoSampling temperature (0-2)

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It mentions 'legacy endpoint' but gives no details on side effects, rate limits, authentication, response format, or deprecation warnings. This is a thin behavioral picture.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, focused sentence that conveys the core purpose and context. Every word earns its place, with no redundancy or rambling.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of annotations and output schema, the description is somewhat under-specified for a 5-parameter tool. It does say 'generate text completions', which implies a text response, but does not address streaming, error handling, or legacy-specific caveats. Still, the schema is thorough, so the overall context is adequate for a simple generation tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds no parameter-specific insight beyond what the schema already documents; it only provides the tool-level 'legacy' context, which does not materially enhance parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool generates text completions and notes it is a legacy endpoint using LiteLLM, which is a specific verb+resource. It distinguishes itself from chat_completion by signaling 'legacy', but does not name the sibling alternative explicitly.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description subtly implies usage is for legacy completion scenarios, but provides no explicit guidance on when to use this versus chat_completion or other alternatives. There is no exclusions or when-not-to-use information.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_embeddingB

Generate embeddings using LiteLLM

ParametersJSON Schema
NameRequiredDescriptionDefault
inputYesText or array of texts to embed
modelYesThe embedding model to use (e.g., text-embedding-ada-002)

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the burden of disclosing behavior. It only states the function without mentioning side effects, authentication requirements, rate limits, or return format. 'Generate' implies a creation, but no context is given regarding whether this is a safe read-only operation or incurs costs.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that is front-loaded with the action and resource. It contains no filler or redundant information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a two-parameter tool with no output schema and no annotations, the description is too sparse. It does not explain what the output looks like, typical use cases, or call constraints. Given the sibling list includes multiple model-related tools, some differentiation guidance is expected.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description covers 100% of parameters, so the description need not add much. However, it adds no additional meaning beyond the schema—it does not explain how the model and input parameters interact or provide examples.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the action ('Generate') and the resource ('embeddings'), and specifies the framework ('using LiteLLM'). This unambiguously distinguishes it from sibling tools like chat_completion, create_image, and create_speech.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives. There is no mention of scenarios, prerequisites, or exclusions relative to other model-related tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_imageB

Generate images using LiteLLM (/images/generations)

ParametersJSON Schema
NameRequiredDescriptionDefault
nNoThe number of images to generate.
sizeNoThe size of the generated images. (e.g. 1024x1024)1024x1024
modelNoThe model to use for image generation.
promptYesA text description of the desired image(s).

TDQS

B3.2/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of behavioral disclosure. It only states 'Generate images' without mentioning side effects, authentication needs, cost implications, or what happens with the generated output.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that front-loads the core action and resource, containing no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Despite the fully described input schema, the description lacks usage context, behavioral notes, and return value expectations, making it insufficient for confidently using the tool in complex scenarios.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema has 100% coverage with descriptions for all four parameters, so the description does not need to add parameter details. It offers no additional meaning beyond the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's function ('Generate images') and identifies the endpoint ('LiteLLM (/images/generations)'), which distinguishes it from sibling tools like chat_completion or create_speech.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, nor does it mention any prerequisites or exclusions for usage.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

create_speechA

Generate speech audio from text using LiteLLM (/audio/speech)

ParametersJSON Schema
NameRequiredDescriptionDefault
inputYesThe text to generate audio for.
modelYesThe model to use for speech generation (e.g., tts-1).
voiceYesThe voice to use for generation (e.g., alloy, echo, fable).alloy

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden. It only states the core function and endpoint but does not disclose output format, potential errors, rate limits, or any safety-relevant behavior. This is a minimal disclosure.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, front-loaded with the key action and resource. It includes the endpoint reference without unnecessary fluff, making it highly concise and well-structured.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple TTS tool with fully documented parameters, the description covers the basic purpose and endpoint. However, without an output schema, it lacks information about return values (e.g., audio format, download vs. base64), which is a notable gap.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so parameters are already well-documented. The description adds no extra meaning beyond the schema, but it does align with the 'input' parameter by mentioning text. Baseline of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool generates speech audio from text, using a specific verb ('Generate') and resource ('speech audio from text'). It also mentions the LiteLLM endpoint, which distinguishes it from sibling tools like chat_completion or create_image.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies its use case (text-to-speech) but does not explicitly mention when to use it versus alternatives or any exclusions. No sibling tool overlaps, so the purpose is clear, but no direct guidance is provided.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

health_checkA

Check the health status of your LiteLLM instance

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full responsibility for behavioral disclosure. It only states that it checks health, but does not mention if it is read-only, what response format is returned, or any other behavioral traits.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, direct sentence with no wasted words, clearly front-loaded with the action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple health check tool, the description is minimally viable but lacks information about return values or the meaning of 'health status'. With no output schema and no annotations, it could be more complete by describing expected behavior.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, so the description does not need to explain parameter semantics. The baseline of 4 applies here as no parameter details are required.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool checks the health status of a LiteLLM instance with a specific verb and resource. It distinguishes itself from sibling tools that handle keys, models, and completions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance is provided on when to use this tool versus alternatives, nor any exclusions. The intended usage is only implied by the tool's name and simple description.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

key_generateB

Generate a new LiteLLM Proxy API key (/key/generate)

ParametersJSON Schema
NameRequiredDescriptionDefault
modelsNoList of models the key is allowed to access
team_idNoOptional Team ID to associate with the key
durationNoDuration for the key to remain valid (e.g., 1h, 30d)
metadataNoAny additional metadata to store with the key
max_budgetNoMaximum spend budget in USD

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden of disclosing side effects and requirements. It only says 'Generate', but does not mention authorization needs, that a new key is created with potential spend implications, or what the response (e.g., the key value) looks like. This leaves important behavioral traits undisclosed.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence that is front-loaded with the action and includes the endpoint path. It is concise without waste, but it omits any broader context; still, it is appropriately brief for a simple creation tool.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool has no annotations, no output schema, and only a one-line description. For a key generation tool, an agent needs to know what the response contains (the key), whether admin permissions are required, and how it relates to key_info. This minimal description does not satisfy those needs, making it incomplete for the given complexity.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema provides complete descriptions for all 5 parameters (100% coverage), so the description does not need to elaborate. The description adds no additional parameter semantics, but the schema is sufficient, leading to a baseline score of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Generate' and the resource 'a new LiteLLM Proxy API key', precisely defining the action. It distinguishes from sibling tools like key_info (which queries existing keys) and model listing tools, making the purpose unambiguous.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, such as whether key_info should be used to review existing keys or if specific prerequisites exist. It is a bare statement of purpose with no context for selection.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

key_infoA

Get details and spend info for a LiteLLM Proxy API key (/key/info)

ParametersJSON Schema
NameRequiredDescriptionDefault
keyNoThe virtual key to look up. If omitted, info for the current proxy API key is returned.

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries the full burden of disclosing behavior. It only states that it retrieves details and spend info, without mentioning authentication requirements, potential errors, pagination, or return format. This lacks transparency for a read operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence that immediately states the action and resource. It includes the endpoint for clarity without unnecessary details, giving it maximum conciseness and front-loading.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is relatively simple with one optional parameter and no output schema. However, the description does not elaborate on what 'details and spend info' entails, such as specific fields or limitations, leaving some ambiguity about the returned data. It is minimally viable but not exhaustive.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema description covers 100% of the single parameter, including its meaning and default behavior (omitting key returns current key info). The description adds no extra parameter semantics beyond the schema, so the baseline of 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: getting details and spend information for a LiteLLM Proxy API key, with a specific endpoint reference. This distinguishes it from the sibling key_generate tool, which is about creating keys.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is used for retrieving key info, but it does not explicitly state when to use it versus alternatives, nor any exclusions or prerequisites. The sibling list includes key_generate, yet no comparison is made.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_modelsA

List all available models from your LiteLLM instance

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.3/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden. It states a read-only 'list' operation, which clearly implies no side effects. It also specifies the scope ('from your LiteLLM instance'). While it does not explicitly discuss authentication or response format, the behavior is straightforward and transparent for a simple list operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, concise sentence that gets straight to the point. It is front-loaded with the action and resource, containing no filler or redundant information. Every word earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's low complexity (zero parameters, no output schema), the description is complete. It clearly explains what the tool does (lists available models) without needing to describe return values or edge cases. The context is fully covered.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, and the input schema is empty. The baseline for 0 parameters is 4, and the description adds no parameter information because none exist. There is no need for further elaboration.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'List all available models from your LiteLLM instance'. It uses a specific verb ('list'), identifies the resource ('available models'), and scopes it to the user's LiteLLM instance. This distinguishes it from siblings like model_info, which likely provides details on a specific model, and chat_completion, which handles completions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage—when you need to see all available models, use this tool—but it does not explicitly mention alternatives or when not to use it. No exclusions are given, and sibling tools like model_info are not referenced. The intent is clear but not explicitly differentiated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

model_infoA

Get detailed information about a specific model

ParametersJSON Schema
NameRequiredDescriptionDefault
modelYesThe model name to get information about

TDQS

A3.5/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must carry the full burden of behavioral disclosure. The verb 'Get' implies a read-only operation, but the description does not disclose what 'detailed information' includes, potential response formats, or any error conditions. It adds little beyond the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, clear sentence with no wasted words. It is front-loaded with the main action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple 1-parameter tool, the description is adequate but minimal. Without an output schema, it does not explain what 'detailed information' will be returned, which could be considered incomplete. However, given the low complexity, the current level may be sufficient.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the parameter 'model' is already fully described in the schema. The description's use of 'specific model' aligns with the schema but does not add additional meaning. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose with a specific verb ('Get') and resource ('detailed information about a specific model'). The word 'specific' distinguishes it from the sibling tool 'list_models', which lists models.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage context is implied by the phrase 'specific model', suggesting it is used when you need info about one model rather than a list. However, there is no explicit mention of when to use this tool versus alternatives like 'list_models', and no exclusions are stated.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

rerankB

Rerank documents based on a query using LiteLLM (/rerank)

ParametersJSON Schema
NameRequiredDescriptionDefault
modelYesThe model to use for reranking.
queryYesThe search query.
top_nNoThe number of top documents to return.
documentsYesA list of document texts to rerank.

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description is the sole source of behavioral information. It only states the basic action and does not disclose what the output looks like (e.g., ordered list with scores), whether the operation is read-only, or any rate limits or error conditions. This is minimal and leaves the agent with little expectation of behavior beyond the bare operation.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single sentence, efficient and immediately front-loaded with the key verb and object. The trailing '/rerank' is slightly redundant but not confusing. It earns a high conciseness score, though it could be even cleaner without that detail.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With no output schema and no annotations, the description should explain the return value (e.g., reranked document order and scores) and any contextual prerequisites. None are provided. For a 4-parameter tool, this sparse description leaves the agent uncertain about the expected result, making it incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The schema descriptions cover all parameters with 100% coverage, so the baseline is 3. The description adds no additional meaning beyond the schema, neither clarifying top_n semantics nor providing examples. It does not harm comprehension but contributes no extra value.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 'rerank' and identifies the resource (documents) and the query criterion. It clearly distinguishes this tool from siblings like chat_completion or create_embedding, none of which mention reranking. The reference to LiteLLM adds implementation context without obscuring the primary purpose.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies the tool is for reranking documents against a query, but it does not explicitly state when to use it versus alternatives or provide exclusions. No prerequisites or typical invocation scenarios are mentioned, leaving usage context implied rather than explicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.

  1. 11 tool updatesv1.0.2
    • First observedchat_completion
    • First observedcompletion
    • First observedcreate_embedding
    • First observedcreate_image
    • First observedcreate_speech
    • First observedhealth_check
    • First observedkey_generate
    • First observedkey_info
    • First observedlist_models
    • First observedmodel_info
    • First observedrerank

TDQS

B3.4/5.0
Disambiguation4/5

Most tools target distinct resources (keys, models, health, embeddings, images, speech, rerank), but chat_completion and completion could be confused as both generate text. Descriptions help clarify that one is for chat and the other is a legacy endpoint.

Naming Consistency2/5

Naming conventions are mixed: some follow verb_noun (list_models, create_embedding), others noun_verb (key_generate, model_info), and some are single nouns or verbs (completion, health_check, rerank). This inconsistency makes the tool surface harder to scan.

Tool Count5/5

With 11 tools, the set is well-scoped for a LiteLLM proxy bridge, covering key management, model introspection, and a variety of generation endpoints without feeling bloated or overly sparse.

Completeness4/5

Core operations are covered: key generation/info, model listing/info, chat and text completions, embeddings, image, speech, and rerank. Minor gaps exist, such as no key deletion/update or audio transcription, but most typical workflows are supported.

Maintenance

ActivityInactive
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/AbhishekMore-1/litellm-proxy-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server