nvidia-nim-mcp
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
| LOG_LEVEL | No | Log level: error, warn, info, debug. | info |
| MAX_RETRIES | No | Max retry attempts on failure. | 3 |
| DEFAULT_MODEL | No | Default model for generation. | black-forest-labs/flux.1-dev |
| ENABLE_VISION | No | Enable vision/multimodal tools. | true |
| NVIDIA_API_KEY | Yes | Your NVIDIA NGC API key (nvapi-...). Required. | |
| RETRY_DELAY_MS | No | Base delay between retries in milliseconds. | 1000 |
| ENABLE_MULTIMODAL | No | Enable multimodal task tools. | true |
| REQUEST_TIMEOUT_MS | No | Request timeout in milliseconds. | 120000 |
| NVIDIA_NIM_BASE_URL | No | Base URL for NIM API. | https://integrate.api.nvidia.com/v1 |
| MAX_TOKENS_PER_REQUEST | No | Hard cap on tokens per request. | 4096 |
| ENABLE_IMAGE_GENERATION | No | Enable image generation tools. | true |
| MAX_REQUESTS_PER_MINUTE | No | Rate limit cap. | 40 |
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| chat_completionA | Send a multi-turn conversation to a NVIDIA NIM language model and receive a completion. Supports all major open-source LLMs including Llama 3.1, Mistral, Gemma, Qwen, and more. |
| text_generationA | Generate text from a single prompt (simplified interface). Ideal for one-shot tasks like summarization, translation, extraction, or Q&A. |
| create_embeddingsA | Convert text(s) into vector embeddings using NVIDIA NIM embedding models. Useful for semantic search, RAG, clustering, and similarity comparisons. |
| rerank_passagesA | Rerank a list of passages by relevance to a query using NVIDIA NIM reranking models. Essential for RAG pipelines to improve retrieval quality. |
| function_callingC | Use NIM models with tool/function calling capabilities. The model will decide which function to call and with what arguments. |
| get_model_infoB | Get detailed information about a specific NVIDIA NIM model. |
| generate_imageA | Generate images from text prompts using NVIDIA NIM image generation models (Stable Diffusion XL, SDXL Turbo, SD3, FLUX.1). Supports various resolutions, samplers, and schedulers. FLUX.1-schnell and FLUX.1-kontext-dev are available on the free NVIDIA AI Foundation tier. Can save generated images as PNG files to disk. |
| analyze_imageB | Analyze and describe images using NVIDIA NIM vision and multimodal models. Provide an image URL and a prompt/question to get detailed analysis, captioning, or visual Q&A. |
| multimodal_taskB | Perform multimodal tasks combining text and images. Send a conversation with mixed text and image content to multimodal models for complex reasoning across modalities. |
| list_modelsB | List available NVIDIA NIM models with detailed metadata for agent selection, optionally filtered by category (language, embedding, reranking, vision, code, multimodal, image_generation) and advanced filters. |
| compare_modelsA | Compare 2-5 models side-by-side across key decision factors: licensing, hardware requirements, benchmarks, capabilities, and use case tags. Returns structured comparison table. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/david-eve-za/nvidia-nim-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server