Skip to main content
Glama

NVIDIA MCP

Local MCP server for NVIDIA NIM and Visual GenAI APIs. It exposes small, practical tools for:

  • checking NVIDIA API configuration

  • listing available NVIDIA models

  • running chat completions through NVIDIA-hosted LLMs

  • generating images through NVIDIA hosted Visual GenAI endpoints

This repository is a personal MCP wrapper. It does not contain an NVIDIA API key and does not run image generation locally; the MCP process runs on the local machine and calls NVIDIA-hosted APIs for inference.

Key Loading

The server does not store secrets in this repository.

It loads environment variables from:

  1. NVIDIA_MCP_ENV_FILE, when provided

  2. this repository's .env, when present

  3. process environment variables

Supported key names:

  • NVIDIA_API_KEY

  • NGC_API_KEY

  • NVIDIA_KEY

  • nvidia-key

nvidia-key is accepted for compatibility with an existing local .env, but NVIDIA_API_KEY is preferred for new setups.

Related MCP server: MolMIM MCP Server

Codex MCP Config

Example:

[mcp_servers.nvidiaMcp]
command = "node"
args = ["/path/to/minsoo-nvidia-mcp/src/server.mjs"]
env_vars = ["NVIDIA_API_KEY", "NGC_API_KEY", "NVIDIA_KEY"]

[mcp_servers.nvidiaMcp.env]
NVIDIA_MCP_ENV_FILE = "/path/to/.env"
NVIDIA_MCP_OUTPUT_DIR = "/path/to/minsoo-nvidia-mcp/output"

Image Generation Defaults

The current default image endpoint is:

https://ai.api.nvidia.com/v1/genai/black-forest-labs/flux.2-klein-4b

The MCP uses short, direct, one-paragraph prompts best for FLUX-style image generation. Avoid committing generated images unless they are intentionally part of an example or release artifact.

Safety Defaults

Image generation defaults to dry_run=true so a tool call can preview the request without consuming API credits. Set dry_run=false only when you intentionally want to generate an image.

GitHub Safety

Before publishing:

  • keep .env untracked

  • keep node_modules/ untracked

  • keep output/ untracked unless intentionally publishing sample output

  • commit .env.example, not a real key file

Available Tools

4 tools
chat_completionNVIDIA Chat CompletionB

Run a non-streaming chat completion through NVIDIA's OpenAI-compatible API.

ParametersJSON Schema
NameRequiredDescriptionDefault
modelNonvidia/nemotron-3-ultra-550b-a55b
promptYesUser prompt.
max_tokensNo
temperatureNo
include_usageNo
system_promptNoOptional system instruction.

TDQS

B3.3/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided. Description mentions 'non-streaming' but does not disclose side effects, authentication, rate limits, or error behavior. Minimal but not misleading.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with purpose. No wasted words, but could include brief parameter context without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

No output schema, so return value unclear. Sibling tools are listed but not differentiated. Description is adequate for a simple tool but lacks depth.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is low (33%). Description does not explain key parameters like max_tokens, temperature, include_usage, or model beyond their default values and constraints.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'run', the resource 'non-streaming chat completion', and the API provider. It distinguishes from siblings like generate_image and list_models.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., streaming, other API calls). No mention of prerequisites or context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

check_nvidia_setupCheck NVIDIA SetupA

Check whether the NVIDIA MCP can see an API key and which base URLs/output directory it will use.

ParametersJSON Schema
NameRequiredDescriptionDefault
probeNoWhen true, call /models to verify the key.

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries full burden. It states the tool checks for an API key and reveals URLs/output directory, but does not disclose if any state changes occur or if it requires network access. The behavior is simple but could be more explicit.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single, well-structured sentence conveys the tool's purpose efficiently without superfluous words. Perfect conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's simplicity (one optional boolean parameter, no output schema), the description is largely complete. It states what is checked, though it could mention that no output is returned or what 'sees an API key' means in practice.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% as the only parameter (probe) has a description. The tool description does not add additional meaning beyond what the schema provides, so baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool checks for API key presence and identifies base URLs and output directory. This is a distinct diagnostic purpose from sibling tools like chat_completion or generate_image, which are execution-oriented.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage for verifying configuration before running other tools, but it does not explicitly state when not to use it or contrast with alternatives. The context is clear but lacks exclusion guidance.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

generate_imageNVIDIA Image GenerationB

Generate an image through NVIDIA's OpenAI-compatible image generation API. Defaults to dry_run=true to avoid accidental credit usage.

ParametersJSON Schema
NameRequiredDescriptionDefault
nNo
sizeNo1024x1024
forceNo
modelNoblack-forest-labs/flux.2-klein-4b
promptYesImage prompt.
dry_runNo
output_pathNoOutput path. Relative paths are resolved from this repository.

TDQS

B3.4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

The description discloses one key behavioral trait: 'Defaults to dry_run=true to avoid accidental credit usage.' This is valuable as it indicates the tool has a safety mechanism. However, with no annotations provided, the description carries the full burden for behavioral transparency, and it omits other important aspects such as required authentication, rate limits, or error handling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is highly concise with two sentences, no redundant information. The first sentence establishes the purpose, and the second provides a critical behavioral note. It is front-loaded and earns its place without excess.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the tool's complexity (7 parameters, no output schema, no annotations), the description is incomplete. It does not explain the meaning of most parameters, the format of the generated image, error scenarios, or usage context. The dry_run note is helpful but insufficient for full understanding.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is low (29%). The description adds meaning to the dry_run parameter by explaining its default and purpose, which is not in the schema. It also provides context about the API being 'OpenAI-compatible.' However, it does not elaborate on other parameters like n, size, model, or force, leaving gaps in understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool's purpose: 'Generate an image through NVIDIA's OpenAI-compatible image generation API.' It uses a specific verb and resource, and the title 'NVIDIA Image Generation' reinforces this. It distinguishes from sibling tools (chat_completion, check_nvidia_setup, list_models) which have different functions.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description lacks guidance on when to use this tool versus alternatives. It mentions the dry_run default to prevent accidental credit usage, but does not provide context for appropriate use cases or when not to use it (e.g., for simple text or other types of generation). No comparison with sibling tools is given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

list_modelsList NVIDIA ModelsB

List models visible to the configured NVIDIA API key.

ParametersJSON Schema
NameRequiredDescriptionDefault
limitNo
filterNoOptional case-insensitive substring filter.

TDQS

B3.1/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must carry the full burden. It mentions visibility depends on the API key, but lacks details on whether the operation is read-only, destructive, rate-limited, or paginated. This is insufficient transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no redundant words. It efficiently conveys the core purpose without extraneous information.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no output schema and two parameters, the description is too minimal. It omits expected return format, pagination behavior, error handling, and how filters affect results. A more complete description is needed for reliable agent invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 50% (only 'filter' has a description). The description adds no meaning beyond the schema—it does not address parameters like 'limit' (pagination) or how 'filter' works. It fails to compensate for the schema gaps.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb ('list') and the resource ('models') with a specific scope ('visible to the configured NVIDIA API key'). It distinguishes the tool from siblings like 'chat_completion' and 'generate_image'.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No usage guidelines are provided. The description does not indicate when to use this tool vs. alternatives (e.g., how it differs from 'check_nvidia_setup'). No exclusions or context for selection are given.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 4 tool updatesv0.1.0
    • First observedchat_completion
    • First observedcheck_nvidia_setup
    • First observedgenerate_image
    • First observedlist_models

TDQS

A3.7/5.0

Scored across 4 tools

Disambiguation5/5

Each tool targets a distinct function: chat completion, setup verification, image generation, and model listing. No overlap in purposes.

Naming Consistency5/5

All tools use snake_case with clear verb-noun structure: chat_completion, check_nvidia_setup, generate_image, list_models. Perfectly consistent.

Tool Count5/5

Four tools is well-scoped for a wrapper around NVIDIA's API, covering essential operations without unnecessary bloat.

Completeness4/5

Covers core operations but lacks streaming completions and embeddings, which are common in similar APIs. The generate_image tool also has limited visible parameters.

Maintenance

ActivityStale
ResponsivenessNo issues

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Connectors

Related MCP Servers