nvidia-mcp
Provides free access to NVIDIA's hosted model catalog on build.nvidia.com, with automatic model routing and tools for searching, calling, probing, and cross-checking models across categories like reasoning, vision, code, translation, and embeddings.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@nvidia-mcpExplain this Python code and suggest improvements"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
NVIDIA MCP — Free Access to 100+ AI Models
An MCP server that gives Claude, Cursor, and any other AI agent free access to NVIDIA's hosted model catalog — Nemotron, Llama, GPT-OSS, DeepSeek, vision models, and embeddings — through one API key, with automatic model routing.
NVIDIA MCP is a Model Context Protocol server that connects your AI coding agent to build.nvidia.com. You get a free NVIDIA API key, add one config block, and your agent can call more than 100 models: reasoning models for hard problems, vision models for images, code models for refactoring, and embedding models for semantic search. The server picks the right model for each task automatically, so you describe the job instead of memorizing model names.
Why use it
Free NVIDIA API credits. NVIDIA gives developers free credits on build.nvidia.com. No credit card to start.
One key, 100+ models. Nemotron, Llama 3.3, GPT-OSS, DeepSeek, Riva translation, NV-Embed, and more — all through a single OpenAI-compatible endpoint.
Automatic routing. Say "refactor this module" or "bu görseldeki tabloyu çıkar" and the server picks a suitable model. English and Turkish task descriptions are both understood.
Parallel cross-checking.
nv_fanoutsends one prompt to up to 6 models at once and returns every answer side by side — useful when one model's answer isn't enough.Honest availability data. Being listed in NVIDIA's catalog does not mean a model is servable. This repo ships measured probe results and a
nv_probetool so you can verify your own account.
Related MCP server: Model Hub MCP
How to get a free NVIDIA API key
You need an nvapi-... key from NVIDIA. It takes about two minutes.
Go to build.nvidia.com.
Click Login (top right) and sign in, or create a free NVIDIA account. A personal email works; you do not need an enterprise account.
Open any model page — for example llama-3.3-70b-instruct.
Click the Get API Key button on that page (usually above the code sample on the right).
Click Generate Key. Your key appears once, starting with
nvapi-.Copy it immediately and store it somewhere safe. NVIDIA will not show it again — you would have to generate a new one.
Notes on the free tier:
New accounts receive free API credits, enough for a substantial amount of experimentation.
The same key works for every model in the catalog; you do not generate a separate key per model.
Credits and per-model availability depend on your account tier. Run
nv_probe(below) to see exactly what your key can reach.
Install
git clone https://github.com/holm-digital-io/nvidia-mcp.git
cd nvidia-mcp
python3 -m venv .venv
.venv/bin/pip install -e .Create a .env file next to the package:
NVIDIA_API_KEY=nvapi-your-key-hereVerify:
.venv/bin/python -c "from nvidia_mcp import client; print(len(client.list_model_ids()), 'models reachable')"Connect it to your agent
Claude Code
Add to .mcp.json in your project root:
{
"mcpServers": {
"nvidia-models": {
"command": "/absolute/path/to/nvidia-mcp/.venv/bin/python",
"args": ["-m", "nvidia_mcp.server"],
"env": { "PYTHONPATH": "/absolute/path/to/nvidia-mcp" }
}
}
}Cursor
Add the same block to ~/.cursor/mcp.json.
Claude Desktop
Add the same block to claude_desktop_config.json
(macOS: ~/Library/Application Support/Claude/, Windows: %APPDATA%\Claude\).
Restart the client afterwards so it picks up the new server.
Tools
Tool | What it does |
| Lists every task category the router knows, with its top models. |
| Live model list from your account, tagged by capability and liveness. |
| "What should I use for X?" Recommends models without calling any. |
| Verifies the API key and reports catalog size. |
| Actually calls each model and reports which ones answer, and how fast. |
| Calls one specific model. Supports images for vision models. |
| Routes and runs in one step. Pass an image and it selects a vision model. |
| Runs one prompt across up to 6 models in parallel, returns all answers. |
| Embeds texts. Returns shape only unless you pass |
| Ranks candidate strings against a query by cosine similarity. |
Images can be passed as an HTTPS URL, a data: URI, or a local file path — the server base64-encodes local files for you.
Task categories
reasoning, general_chat, fast_cheap, code, vision, document_parse,
embedding, embedding_code, embedding_multimodal, rag_qa, safety,
reward, translation, creative, long_context, domain_medical,
domain_finance, video, image_gen.
Routing has two layers: a hand-ranked table in nvidia_mcp/catalog.py, plus name-pattern heuristics so models NVIDIA adds later still get tagged. Curated position encodes quality; measured liveness is applied as a separate filter, so a code specialist still outranks a faster generalist inside code.
Which models actually respond?
This is the part most NVIDIA integrations get wrong. GET /v1/models returned 102 model ids, but on a free-tier key only about a third answer a request — the rest return 404 Not Found or never respond.
Measured on 2026-08-11 (free tier, 45s timeout). Fastest first:
Model | Response | Best for |
| 1.0s | fast, cheap |
| 1.1s | translation |
| 1.5s | vision |
| 1.7s | fast, cheap |
| 1.8s | general |
| 1.9s | reasoning |
| 2.1s | fast, cheap |
| 2.1s | moderation |
| 2.4s | vision |
| 2.7s | fast, cheap |
| 6.7s | vision |
| 7.1s | creative |
| 13.8s | reasoning |
| 15.6s | general |
| 18.3s | reasoning |
| 20.5s | code |
| 21.4s | general, long context |
| 24.0s | general |
| 39.1s | reasoning |
Embedding models that answered: nvidia/nemotron-3-embed-1b (1.2s, 2048-dim), nvidia/nv-embedqa-e5-v5 (1.3s, 1024), nvidia/nv-embedcode-7b-v1 (3.0s, 4096), nvidia/nv-embed-v1 (3.7s, 4096), nvidia/llama-nemotron-embed-1b-v2 (4.8s, 2048), nvidia/llama-nemotron-embed-vl-1b-v2 (10.0s, 2048).
Availability is per-account and changes over time. Re-measure yours:
Ask your agent: "run nv_probe"Examples
Ask your agent in plain language; it selects the tool.
Route without calling
Which NVIDIA model should I use to extract a table from a scanned invoice?
Run with automatic model choice
Use nv_auto to describe what's in ./screenshot.png
Cross-check one question across models
Use nv_fanout to ask three models whether this SQL query has an injection risk
Semantic ranking
Use nv_similarity to rank these 20 support tickets against "billing problem"
FAQ
Is the NVIDIA API really free? NVIDIA gives developers free credits on build.nvidia.com, which is enough for meaningful development and testing without a credit card. It is free credits, not unlimited free inference — heavy production use eventually requires a paid plan or self-hosted NIM containers.
Do I need an NVIDIA GPU? No. Every model runs on NVIDIA's cloud. This server only sends HTTPS requests, so it works fine on a Mac, a Windows laptop, or a small Linux VM.
Which models are best for coding?
On the free tier, poolside/laguna-xs-2.1 is the only dedicated code model that responds; the other code-specific ids (Codestral, CodeLlama, StarCoder2, CodeGemma) return 404. The server therefore lists strong generalists — nvidia/nemotron-3-super-120b-a12b and meta/llama-3.3-70b-instruct — as first-class fallbacks in the code category.
Why did a model return empty text?
Reasoning models spend their token budget on reasoning_content before writing an answer. If you cap max_tokens too low, text comes back empty. The server detects this and returns a note telling you to raise max_tokens (4096+ for reasoning models). nv_auto raises it automatically for reasoning tasks.
Why does a model in the catalog return 404?
GET /v1/models lists the full NVIDIA catalog, not what your specific key is entitled to call. Roughly two thirds of listed ids are not servable on a free-tier key. Run nv_probe for ground truth on your account.
Does it work with Cursor and Claude Desktop? Yes. It is a standard stdio MCP server, so any MCP-compatible client works — Claude Code, Claude Desktop, Cursor, Windsurf, Cline, and others.
Is my API key sent anywhere else?
No. The key is read from your local .env, used only in the Authorization header to integrate.api.nvidia.com, and is never logged or included in any tool response.
Configuration
Variable | Default | Purpose |
| — | Required. Your |
|
| Point at self-hosted NIM instead. |
|
| Per-request timeout in seconds. |
Development
.venv/bin/python tests/test_routing.py # routing regression suite
.venv/bin/python -m nvidia_mcp.server # run the server directly over stdioLicense
MIT — see LICENSE.
Not affiliated with or endorsed by NVIDIA Corporation. "NVIDIA", "Nemotron", and "NIM" are trademarks of NVIDIA Corporation.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseAqualityDmaintenanceAn MCP server that enables AI applications to access 20+ model providers (including OpenAI, Anthropic, Google) through a unified interface for text and image generation.230MIT
- AlicenseBqualityDmaintenanceAn MCP server that retrieves and provides AI model information from OpenAI, Anthropic, and Google through a unified interface.320MIT
- AlicenseAqualityCmaintenanceMCP server that pings 130+ free coding LLM models across 17 providers in real-time, ranks them by latency, and helps AI agents pick the fastest available model.21MIT
- Alicense-qualityCmaintenanceAn MCP server that gives AI assistants access to a multi-agent business operations platform with specialized AI services covering real estate, legal, translation, research, content creation, training, and more.46MIT
Related MCP Connectors
An MCP server that integrates with Discord to provide AI-powered features.
Hosted MCP server connecting claude.ai, ChatGPT and other AI apps to your own computer
MCP server for AI dialogue using various LLM models via AceDataCloud
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/holm-digital-io/nvidia-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server