LiteLLM MCP Server Bridge
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@LiteLLM MCP Server BridgeList available models"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
LiteLLM MCP Server Bridge
A Model Context Protocol (MCP) server that connects Antigravity to your deployed LiteLLM instance.
Features
This MCP server provides the following tools:
chat_completion - Generate chat completions using any model in your LiteLLM instance
completion - Generate text completions using the legacy endpoint
list_models - List all available models
health_check - Check LiteLLM instance health status
create_embedding - Generate embeddings
model_info - Get detailed information about a specific model
create_image - Generate images using models available in your instance
create_speech - Generate speech audio from text (TTS)
rerank - Rerank documents based on a search query
key_generate - Generate a new LiteLLM Proxy API key (admin feature)
key_info - Get details and spend info for a LiteLLM Proxy API key (admin feature)
Related MCP server: A2A Client MCP Server
Setup
1. Configure Antigravity
Add the following to your Antigravity MCP configuration. This will use npx to fetch and run the latest version of the published package on-the-fly.
{
"mcpServers": {
"litellm": {
"command": "npx",
"args": [
"-y",
"litellm-mcp-server@latest"
],
"env": {
"LITELLM_BASE_URL": "https://your-litellm-url",
"LITELLM_API_KEY": "your-api-key-here"
}
}
}
}2. Set Your Secrets
Replace your-litellm-url and your-api-key-here in the configuration with your actual LiteLLM Base URL and API key.
Usage Examples
Once configured, you can use the MCP tools in Antigravity:
Chat Completion
Use the chat_completion tool to generate a response using gpt-4List Models
Use the list_models tool to see what models are availableHealth Check
Use the health_check tool to verify the LiteLLM instance is runningEnvironment Variables
LITELLM_BASE_URL- Your LiteLLM instance URLLITELLM_API_KEY- Your LiteLLM API key for authentication
Troubleshooting
Server won't start
Ensure Node.js is installed:
node --versionCheck dependencies are installed:
npm installVerify the script path in your Antigravity config is correct
Check that your API key is valid
Connection errors
Verify your LiteLLM instance is accessible:
curl https://your-litellm-url/healthCheck your API key has proper permissions
Ensure your network allows connections to the LiteLLM instance
Tool not showing up
Restart Antigravity after adding the MCP server configuration
Check Antigravity logs for any error messages
Verify the JSON configuration is valid
Architecture
The MCP server acts as a bridge:
Antigravity ←→ MCP Server (this script) ←→ LiteLLM InstanceAll requests from Antigravity are forwarded to your LiteLLM instance with proper authentication headers.
License
MIT
Available Tools
11 toolschat_completionC
Generate chat completions using LiteLLM. Supports all models available in your LiteLLM instance.
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | The model to use (e.g., gpt-4, claude-3-opus, etc.) | |
| top_p | No | Nucleus sampling parameter | |
| stream | No | Whether to stream the response | |
| messages | Yes | Array of message objects with role and content | |
| max_tokens | No | Maximum tokens to generate | |
| temperature | No | Sampling temperature (0-2) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
There are no annotations, so the description must carry the burden of behavioral disclosure. It does not mention authentication requirements, rate limits, streaming behavior, whether the operation is read-only or has side effects, or the shape of the response. The only added behavioral detail is model support, which is static compatibility, not operational behavior.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is composed of two short sentences with no extraneous vocabulary. It leads with the primary function and adds a brief note about model compatibility. While concise, it is perhaps too sparse to be fully informative, but this dimension focuses on lack of bloat.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's moderate complexity (six parameters) and absence of annotations or output schema, the description is insufficiently complete. It doesn't explain return values, potential errors, or any operational caveats, leaving the agent to make assumptions. More behavioral context is needed for reliable invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema provides descriptions for all six parameters, achieving 100% coverage. The description itself does not elaborate on any parameter beyond what the schema already states; for instance, 'model' is described in the schema with examples. Thus, the description adds no additional semantic value over the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly identifies the action ('Generate chat completions') and the platform ('LiteLLM'), providing a specific verb and resource. However, the presence of a sibling tool named 'completion' without any distinguishing commentary means it does not fully differentiate itself from similar tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description offers no guidance on when to use this tool versus alternatives such as 'completion' or other model interaction tools. No usage scenarios, exclusions, or alternative references are provided, leaving the agent without direction for tool selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
completionB
Generate text completions (legacy endpoint) using LiteLLM.
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | The model to use | |
| prompt | Yes | The prompt to generate completions for | |
| stream | No | Whether to stream the response | |
| max_tokens | No | Maximum tokens to generate | |
| temperature | No | Sampling temperature (0-2) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It mentions 'legacy endpoint' but gives no details on side effects, rate limits, authentication, response format, or deprecation warnings. This is a thin behavioral picture.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, focused sentence that conveys the core purpose and context. Every word earns its place, with no redundancy or rambling.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the lack of annotations and output schema, the description is somewhat under-specified for a 5-parameter tool. It does say 'generate text completions', which implies a text response, but does not address streaming, error handling, or legacy-specific caveats. Still, the schema is thorough, so the overall context is adequate for a simple generation tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100%, so the baseline is 3. The description adds no parameter-specific insight beyond what the schema already documents; it only provides the tool-level 'legacy' context, which does not materially enhance parameter understanding.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool generates text completions and notes it is a legacy endpoint using LiteLLM, which is a specific verb+resource. It distinguishes itself from chat_completion by signaling 'legacy', but does not name the sibling alternative explicitly.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description subtly implies usage is for legacy completion scenarios, but provides no explicit guidance on when to use this versus chat_completion or other alternatives. There is no exclusions or when-not-to-use information.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_embeddingB
Generate embeddings using LiteLLM
| Name | Required | Description | Default |
|---|---|---|---|
| input | Yes | Text or array of texts to embed | |
| model | Yes | The embedding model to use (e.g., text-embedding-ada-002) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the burden of disclosing behavior. It only states the function without mentioning side effects, authentication requirements, rate limits, or return format. 'Generate' implies a creation, but no context is given regarding whether this is a safe read-only operation or incurs costs.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that is front-loaded with the action and resource. It contains no filler or redundant information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a two-parameter tool with no output schema and no annotations, the description is too sparse. It does not explain what the output looks like, typical use cases, or call constraints. Given the sibling list includes multiple model-related tools, some differentiation guidance is expected.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema description covers 100% of parameters, so the description need not add much. However, it adds no additional meaning beyond the schema—it does not explain how the model and input parameters interact or provide examples.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Generate') and the resource ('embeddings'), and specifies the framework ('using LiteLLM'). This unambiguously distinguishes it from sibling tools like chat_completion, create_image, and create_speech.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. There is no mention of scenarios, prerequisites, or exclusions relative to other model-related tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_imageB
Generate images using LiteLLM (/images/generations)
| Name | Required | Description | Default |
|---|---|---|---|
| n | No | The number of images to generate. | |
| size | No | The size of the generated images. (e.g. 1024x1024) | 1024x1024 |
| model | No | The model to use for image generation. | |
| prompt | Yes | A text description of the desired image(s). |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of behavioral disclosure. It only states 'Generate images' without mentioning side effects, authentication needs, cost implications, or what happens with the generated output.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that front-loads the core action and resource, containing no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Despite the fully described input schema, the description lacks usage context, behavioral notes, and return value expectations, making it insufficient for confidently using the tool in complex scenarios.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage with descriptions for all four parameters, so the description does not need to add parameter details. It offers no additional meaning beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function ('Generate images') and identifies the endpoint ('LiteLLM (/images/generations)'), which distinguishes it from sibling tools like chat_completion or create_speech.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives, nor does it mention any prerequisites or exclusions for usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
create_speechA
Generate speech audio from text using LiteLLM (/audio/speech)
| Name | Required | Description | Default |
|---|---|---|---|
| input | Yes | The text to generate audio for. | |
| model | Yes | The model to use for speech generation (e.g., tts-1). | |
| voice | Yes | The voice to use for generation (e.g., alloy, echo, fable). | alloy |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden. It only states the core function and endpoint but does not disclose output format, potential errors, rate limits, or any safety-relevant behavior. This is a minimal disclosure.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, front-loaded with the key action and resource. It includes the endpoint reference without unnecessary fluff, making it highly concise and well-structured.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple TTS tool with fully documented parameters, the description covers the basic purpose and endpoint. However, without an output schema, it lacks information about return values (e.g., audio format, download vs. base64), which is a notable gap.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so parameters are already well-documented. The description adds no extra meaning beyond the schema, but it does align with the 'input' parameter by mentioning text. Baseline of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool generates speech audio from text, using a specific verb ('Generate') and resource ('speech audio from text'). It also mentions the LiteLLM endpoint, which distinguishes it from sibling tools like chat_completion or create_image.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies its use case (text-to-speech) but does not explicitly mention when to use it versus alternatives or any exclusions. No sibling tool overlaps, so the purpose is clear, but no direct guidance is provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
health_checkA
Check the health status of your LiteLLM instance
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full responsibility for behavioral disclosure. It only states that it checks health, but does not mention if it is read-only, what response format is returned, or any other behavioral traits.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, direct sentence with no wasted words, clearly front-loaded with the action and resource.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple health check tool, the description is minimally viable but lacks information about return values or the meaning of 'health status'. With no output schema and no annotations, it could be more complete by describing expected behavior.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, so the description does not need to explain parameter semantics. The baseline of 4 applies here as no parameter details are required.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool checks the health status of a LiteLLM instance with a specific verb and resource. It distinguishes itself from sibling tools that handle keys, models, and completions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives, nor any exclusions. The intended usage is only implied by the tool's name and simple description.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
key_generateB
Generate a new LiteLLM Proxy API key (/key/generate)
| Name | Required | Description | Default |
|---|---|---|---|
| models | No | List of models the key is allowed to access | |
| team_id | No | Optional Team ID to associate with the key | |
| duration | No | Duration for the key to remain valid (e.g., 1h, 30d) | |
| metadata | No | Any additional metadata to store with the key | |
| max_budget | No | Maximum spend budget in USD |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries the full burden of disclosing side effects and requirements. It only says 'Generate', but does not mention authorization needs, that a new key is created with potential spend implications, or what the response (e.g., the key value) looks like. This leaves important behavioral traits undisclosed.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence that is front-loaded with the action and includes the endpoint path. It is concise without waste, but it omits any broader context; still, it is appropriately brief for a simple creation tool.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool has no annotations, no output schema, and only a one-line description. For a key generation tool, an agent needs to know what the response contains (the key), whether admin permissions are required, and how it relates to key_info. This minimal description does not satisfy those needs, making it incomplete for the given complexity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema provides complete descriptions for all 5 parameters (100% coverage), so the description does not need to elaborate. The description adds no additional parameter semantics, but the schema is sufficient, leading to a baseline score of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Generate' and the resource 'a new LiteLLM Proxy API key', precisely defining the action. It distinguishes from sibling tools like key_info (which queries existing keys) and model listing tools, making the purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives, such as whether key_info should be used to review existing keys or if specific prerequisites exist. It is a bare statement of purpose with no context for selection.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
key_infoA
Get details and spend info for a LiteLLM Proxy API key (/key/info)
| Name | Required | Description | Default |
|---|---|---|---|
| key | No | The virtual key to look up. If omitted, info for the current proxy API key is returned. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden of disclosing behavior. It only states that it retrieves details and spend info, without mentioning authentication requirements, potential errors, pagination, or return format. This lacks transparency for a read operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single concise sentence that immediately states the action and resource. It includes the endpoint for clarity without unnecessary details, giving it maximum conciseness and front-loading.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The tool is relatively simple with one optional parameter and no output schema. However, the description does not elaborate on what 'details and spend info' entails, such as specific fields or limitations, leaving some ambiguity about the returned data. It is minimally viable but not exhaustive.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema description covers 100% of the single parameter, including its meaning and default behavior (omitting key returns current key info). The description adds no extra parameter semantics beyond the schema, so the baseline of 3 applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: getting details and spend information for a LiteLLM Proxy API key, with a specific endpoint reference. This distinguishes it from the sibling key_generate tool, which is about creating keys.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies the tool is used for retrieving key info, but it does not explicitly state when to use it versus alternatives, nor any exclusions or prerequisites. The sibling list includes key_generate, yet no comparison is made.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
list_modelsA
List all available models from your LiteLLM instance
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden. It states a read-only 'list' operation, which clearly implies no side effects. It also specifies the scope ('from your LiteLLM instance'). While it does not explicitly discuss authentication or response format, the behavior is straightforward and transparent for a simple list operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, concise sentence that gets straight to the point. It is front-loaded with the action and resource, containing no filler or redundant information. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's low complexity (zero parameters, no output schema), the description is complete. It clearly explains what the tool does (lists available models) without needing to describe return values or edge cases. The context is fully covered.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters, and the input schema is empty. The baseline for 0 parameters is 4, and the description adds no parameter information because none exist. There is no need for further elaboration.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'List all available models from your LiteLLM instance'. It uses a specific verb ('list'), identifies the resource ('available models'), and scopes it to the user's LiteLLM instance. This distinguishes it from siblings like model_info, which likely provides details on a specific model, and chat_completion, which handles completions.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage—when you need to see all available models, use this tool—but it does not explicitly mention alternatives or when not to use it. No exclusions are given, and sibling tools like model_info are not referenced. The intent is clear but not explicitly differentiated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
model_infoA
Get detailed information about a specific model
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | The model name to get information about |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must carry the full burden of behavioral disclosure. The verb 'Get' implies a read-only operation, but the description does not disclose what 'detailed information' includes, potential response formats, or any error conditions. It adds little beyond the schema.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, clear sentence with no wasted words. It is front-loaded with the main action and resource.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple 1-parameter tool, the description is adequate but minimal. Without an output schema, it does not explain what 'detailed information' will be returned, which could be considered incomplete. However, given the low complexity, the current level may be sufficient.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the parameter 'model' is already fully described in the schema. The description's use of 'specific model' aligns with the schema but does not add additional meaning. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose with a specific verb ('Get') and resource ('detailed information about a specific model'). The word 'specific' distinguishes it from the sibling tool 'list_models', which lists models.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage context is implied by the phrase 'specific model', suggesting it is used when you need info about one model rather than a list. However, there is no explicit mention of when to use this tool versus alternatives like 'list_models', and no exclusions are stated.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
rerankB
Rerank documents based on a query using LiteLLM (/rerank)
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | The model to use for reranking. | |
| query | Yes | The search query. | |
| top_n | No | The number of top documents to return. | |
| documents | Yes | A list of document texts to rerank. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description is the sole source of behavioral information. It only states the basic action and does not disclose what the output looks like (e.g., ordered list with scores), whether the operation is read-only, or any rate limits or error conditions. This is minimal and leaves the agent with little expectation of behavior beyond the bare operation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, efficient and immediately front-loaded with the key verb and object. The trailing '/rerank' is slightly redundant but not confusing. It earns a high conciseness score, though it could be even cleaner without that detail.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
With no output schema and no annotations, the description should explain the return value (e.g., reranked document order and scores) and any contextual prerequisites. None are provided. For a 4-parameter tool, this sparse description leaves the agent uncertain about the expected result, making it incomplete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema descriptions cover all parameters with 100% coverage, so the baseline is 3. The description adds no additional meaning beyond the schema, neither clarifying top_n semantics nor providing examples. It does not harm comprehension but contributes no extra value.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb 'rerank' and identifies the resource (documents) and the query criterion. It clearly distinguishes this tool from siblings like chat_completion or create_embedding, none of which mention reranking. The reference to LiteLLM adds implementation context without obscuring the primary purpose.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies the tool is for reranking documents against a query, but it does not explicitly state when to use it versus alternatives or provide exclusions. No prerequisites or typical invocation scenarios are mentioned, leaving usage context implied rather than explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections. Dates show when Glama detected each change.
11 tool updates
v1.0.2- First observed
chat_completion - First observed
completion - First observed
create_embedding - First observed
create_image - First observed
create_speech - First observed
health_check - First observed
key_generate - First observed
key_info - First observed
list_models - First observed
model_info - First observed
rerank
TDQS
Most tools target distinct resources (keys, models, health, embeddings, images, speech, rerank), but chat_completion and completion could be confused as both generate text. Descriptions help clarify that one is for chat and the other is a legacy endpoint.
Naming conventions are mixed: some follow verb_noun (list_models, create_embedding), others noun_verb (key_generate, model_info), and some are single nouns or verbs (completion, health_check, rerank). This inconsistency makes the tool surface harder to scan.
With 11 tools, the set is well-scoped for a LiteLLM proxy bridge, covering key management, model introspection, and a variety of generation endpoints without feeling bloated or overly sparse.
Core operations are covered: key generation/info, model listing/info, chat and text completions, embeddings, image, speech, and rerank. Minor gaps exist, such as no key deletion/update or audio transcription, but most typical workflows are supported.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
Connect AI agents to Replynodes over the Model Context Protocol.
Enable secure connectivity between Sentry issues and debugging data, and LLM clients, using a Model Context Protocol (MCP) server.
Connect MCP clients to 2,000+ AI models without managing provider API keys.
Hosted MCP server for LLM cost estimation, model comparison, and budget-aware routing.
Related MCP Servers
- AlicenseBqualityDmaintenanceEnables interaction with Linear's API for managing issues, teams, and projects programmatically through the Model Context Protocol.7833MIT
- FlicenseAqualityNot gradedmaintenanceEnables LLMs to interact with Agent-to-Agent (A2A) protocol compatible agents, allowing them to send tasks, receive responses, track task status, and query agent capabilities through the Model Context Protocol.5-
- AlicenseNot gradedqualityDmaintenanceEnables LLMs to access Blackbird AI's services through the Model Context Protocol, using Blackbird API credentials for authentication.6MIT
- AlicenseNot gradedqualityBmaintenanceConnects QGIS to an LLM through the Model Context Protocol, allowing agentic interaction with and control of QGIS for prompt-assisted project creation, layer loading, code execution, and more.GPL 3.0
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/AbhishekMore-1/litellm-proxy-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server