Skip to main content
Glama

Server Configuration

Describes the environment variables required to run the server.

NameRequiredDescriptionDefault
LOG_LEVELNoLog level: error, warn, info, debug.info
MAX_RETRIESNoMax retry attempts on failure.3
DEFAULT_MODELNoDefault model for generation.black-forest-labs/flux.1-dev
ENABLE_VISIONNoEnable vision/multimodal tools.true
NVIDIA_API_KEYYesYour NVIDIA NGC API key (nvapi-...). Required.
RETRY_DELAY_MSNoBase delay between retries in milliseconds.1000
ENABLE_MULTIMODALNoEnable multimodal task tools.true
REQUEST_TIMEOUT_MSNoRequest timeout in milliseconds.120000
NVIDIA_NIM_BASE_URLNoBase URL for NIM API.https://integrate.api.nvidia.com/v1
MAX_TOKENS_PER_REQUESTNoHard cap on tokens per request.4096
ENABLE_IMAGE_GENERATIONNoEnable image generation tools.true
MAX_REQUESTS_PER_MINUTENoRate limit cap.40

Instructions

Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.

This server publishes no instructions, or was last inspected before Glama recorded them.

Capabilities

Features and capabilities supported by this server

Protocol revision2025-11-25

CapabilityDetails
tools
{}

Tools

Functions exposed to the LLM to take actions

NameDescription
chat_completionA

Send a multi-turn conversation to a NVIDIA NIM language model and receive a completion. Supports all major open-source LLMs including Llama 3.1, Mistral, Gemma, Qwen, and more.

text_generationA

Generate text from a single prompt (simplified interface). Ideal for one-shot tasks like summarization, translation, extraction, or Q&A.

create_embeddingsA

Convert text(s) into vector embeddings using NVIDIA NIM embedding models. Useful for semantic search, RAG, clustering, and similarity comparisons.

rerank_passagesA

Rerank a list of passages by relevance to a query using NVIDIA NIM reranking models. Essential for RAG pipelines to improve retrieval quality.

function_callingC

Use NIM models with tool/function calling capabilities. The model will decide which function to call and with what arguments.

get_model_infoB

Get detailed information about a specific NVIDIA NIM model.

generate_imageA

Generate images from text prompts using NVIDIA NIM image generation models (Stable Diffusion XL, SDXL Turbo, SD3, FLUX.1). Supports various resolutions, samplers, and schedulers. FLUX.1-schnell and FLUX.1-kontext-dev are available on the free NVIDIA AI Foundation tier. Can save generated images as PNG files to disk.

analyze_imageB

Analyze and describe images using NVIDIA NIM vision and multimodal models. Provide an image URL and a prompt/question to get detailed analysis, captioning, or visual Q&A.

multimodal_taskB

Perform multimodal tasks combining text and images. Send a conversation with mixed text and image content to multimodal models for complex reasoning across modalities.

list_modelsB

List available NVIDIA NIM models with detailed metadata for agent selection, optionally filtered by category (language, embedding, reranking, vision, code, multimodal, image_generation) and advanced filters.

compare_modelsA

Compare 2-5 models side-by-side across key decision factors: licensing, hardware requirements, benchmarks, capabilities, and use case tags. Returns structured comparison table.

Prompts

Interactive templates invoked by user choice

NameDescription

No prompts

Resources

Contextual data attached and managed by the client

NameDescription

No resources

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/david-eve-za/nvidia-nim-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server