Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words

Nvidia Nim MCP

by david-eve-zaversion 2.1.2i★ 1iRuns on your computerRepository ↗
Registry nameio.github.david-eve-za/nvidia-nim-mcp

How to install

What it does

MCP server for NVIDIA NIM - 50+ LLMs, multimodal, image gen, embeddings, reranking

  • Connects Runs on your computer
  • Account or key Needs NVIDIA_API_KEY
  • Category Search & AI memory

Use together with

Skills that teach the AI this kind of work; they work alongside this one

timesfm

TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.

by google-research★ 35,6291 skills

Skill · How-to guide

Shadowbroker

Open-source intelligence for the global theater. Track everything from the corporate/private jets of the wealthy, and spy satellites, to seismic events in one unified interface. Hook an AI agent up to have it parse through data and find previously unseen correlations. The knowledge is available to…

by BigBodyCobain★ 11,6021 skills

Skill · How-to guide

google-maps-scraper

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

by gosom★ 8,2091 skills

Skill · How-to guide

Why it ranks here

Lists are ordered by a usage score (out of 100) built from these parts

Popularity4/80GitHub stars or weekly downloads: the larger counts 60, the smaller 20
Freshness3/12Full marks for a release or code change within 30 days
Still answering0/8The cloud endpoint answered at the last check
Usage score7/100

Quality: Passed 3/3 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)

Install

Pick the AI app you use, then copy the settings.

Let your AI install it with one sentence

Please install Nvidia Nim MCP. Follow https://mcp.popnx.com/i/david-eve-za-nvidia-nim-mcp.md, show me the commands and wait for my OK before running them.

Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads

Passed 3/3 checks · Runs on your computer · ✓ Commands checked Nov 14, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude, with some setup first

You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Let AI install it

Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Nvidia Nim MCP for Claude on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "nvidia-nim": { "command": "npx", "args": [ "-y", "nvidia-nim-mcp" ], "env": { "NVIDIA_API_KEY": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For NVIDIA_API_KEY, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Nvidia Nim MCP tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install Node.js (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    node -v
    • A version number such as v26.13.1 = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed

    Open the Node.js download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v

    Install once; it works for everything that needs Node.js

  2. Sign up and create a Nvidia Nim MCP key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Open the Claude desktop app’s settings file

    SettingsDeveloperEdit Config

  4. Paste these settings and save the file

    {
      "mcpServers": {
        "nvidia-nim": {
          "command": "npx",
          "args": [
            "-y",
            "nvidia-nim-mcp"
          ],
          "env": {
            "NVIDIA_API_KEY": "your-value"
          }
        }
      }
    }

    Paste the key only into the app’s field, never into a chat or to anyone

  5. Quit Claude and open it again

  6. Try it

    Use Nvidia Nim MCP and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using Nvidia Nim MCP or shows a Nvidia Nim MCP tool in the answer, you are connected

6 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • NVIDIA_NIM_BASE_URL Base URL for self-hosted NIM endpoints
  • NVIDIA_AI_FOUNDATION_URL Base URL for NVIDIA AI Foundation Models (free tier available)
  • DEFAULT_MODEL Default model to use for chat/text generation
  • ENABLE_IMAGE_GENERATION Enable image generation tools
  • ENABLE_VISION Enable vision/image analysis tools
  • ENABLE_MULTIMODAL Enable multimodal tools

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Nvidia Nim MCP yet

Nvidia Nim MCP runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Nvidia Nim MCP

  • You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
  • You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time)
  • You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time)
  • You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time)

B · Others in Search & AI memory that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Works with Claude Code, with some setup first

You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time)

Let AI install it

Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Nvidia Nim MCP for Claude Code on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user nvidia-nim --env NVIDIA_API_KEY=your-value -- npx -y nvidia-nim-mcp 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For NVIDIA_API_KEY, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Nvidia Nim MCP tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install Node.js (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    node -v
    • A version number such as v26.13.1 = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed

    Open the Node.js download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v

    Install once; it works for everything that needs Node.js

  2. Sign up and create a Nvidia Nim MCP key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  4. Paste this command and press Enter

    claude mcp add --scope user nvidia-nim --env NVIDIA_API_KEY=your-value -- npx -y nvidia-nim-mcp

    Replace “your-value” with your key before pressing Enter

    Paste the key only into the app’s field, never into a chat or to anyone

  5. Type /mcp in Claude Code

    You should see Nvidia Nim MCP listed as connected

  6. Try it

    Use Nvidia Nim MCP and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using Nvidia Nim MCP or shows a Nvidia Nim MCP tool in the answer, you are connected

6 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • NVIDIA_NIM_BASE_URL Base URL for self-hosted NIM endpoints
  • NVIDIA_AI_FOUNDATION_URL Base URL for NVIDIA AI Foundation Models (free tier available)
  • DEFAULT_MODEL Default model to use for chat/text generation
  • ENABLE_IMAGE_GENERATION Enable image generation tools
  • ENABLE_VISION Enable vision/image analysis tools
  • ENABLE_MULTIMODAL Enable multimodal tools

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time)

Let AI install it

Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Nvidia Nim MCP for Cursor on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "nvidia-nim": { "command": "npx", "args": [ "-y", "nvidia-nim-mcp" ], "env": { "NVIDIA_API_KEY": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For NVIDIA_API_KEY, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Nvidia Nim MCP tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install Node.js (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    node -v
    • A version number such as v26.13.1 = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed

    Open the Node.js download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v

    Install once; it works for everything that needs Node.js

  2. Sign up and create a Nvidia Nim MCP key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  4. Fill in your key

    In the Nvidia Nim MCP settings, NVIDIA_API_KEY is empty; add your key and save

    Paste the key only into the app’s field, never into a chat or to anyone

  5. Open the AI chat in Cursor in Agent mode

  6. Try it

    Use Nvidia Nim MCP and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using Nvidia Nim MCP or shows a Nvidia Nim MCP tool in the answer, you are connected

6 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • NVIDIA_NIM_BASE_URL Base URL for self-hosted NIM endpoints
  • NVIDIA_AI_FOUNDATION_URL Base URL for NVIDIA AI Foundation Models (free tier available)
  • DEFAULT_MODEL Default model to use for chat/text generation
  • ENABLE_IMAGE_GENERATION Enable image generation tools
  • ENABLE_VISION Enable vision/image analysis tools
  • ENABLE_MULTIMODAL Enable multimodal tools

Descriptions are as written by the maker.

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

You need a Nvidia Nim MCP key (create it on the maker’s site) · Install Node.js on your computer first (one time)

Let AI install it

Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Nvidia Nim MCP for VS Code on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "nvidia-nim": { "type": "stdio", "command": "npx", "args": [ "-y", "nvidia-nim-mcp" ], "env": { "NVIDIA_API_KEY": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For NVIDIA_API_KEY, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Nvidia Nim MCP tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install Node.js (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    node -v
    • A version number such as v26.13.1 = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed

    Open the Node.js download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v

    Install once; it works for everything that needs Node.js

  2. Sign up and create a Nvidia Nim MCP key

    Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.

    How to get a key is in the maker’s README below

  3. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  4. Fill in your key

    In the Nvidia Nim MCP settings, NVIDIA_API_KEY is empty; add your key and save

    Paste the key only into the app’s field, never into a chat or to anyone

  5. Open the AI chat in VS Code in Agent mode

  6. Try it

    Use Nvidia Nim MCP and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using Nvidia Nim MCP or shows a Nvidia Nim MCP tool in the answer, you are connected

6 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • NVIDIA_NIM_BASE_URL Base URL for self-hosted NIM endpoints
  • NVIDIA_AI_FOUNDATION_URL Base URL for NVIDIA AI Foundation Models (free tier available)
  • DEFAULT_MODEL Default model to use for chat/text generation
  • ENABLE_IMAGE_GENERATION Enable image generation tools
  • ENABLE_VISION Enable vision/image analysis tools
  • ENABLE_MULTIMODAL Enable multimodal tools

Descriptions are as written by the maker.

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Nvidia Nim MCP💬 Discussion →
For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add --scope user nvidia-nim --env NVIDIA_API_KEY=your-value -- npx -y nvidia-nim-mcp

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "nvidia-nim": {
      "command": "npx",
      "args": [
        "-y",
        "nvidia-nim-mcp"
      ],
      "env": {
        "NVIDIA_API_KEY": "your-value"
      }
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "nvidia-nim": {
      "command": "npx",
      "args": [
        "-y",
        "nvidia-nim-mcp"
      ],
      "env": {
        "NVIDIA_API_KEY": "your-value"
      }
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "nvidia-nim": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "nvidia-nim-mcp"
      ],
      "env": {
        "NVIDIA_API_KEY": "your-value"
      }
    }
  }
}

Values you fill in

  • NVIDIA_API_KEY secret required env
    Your NVIDIA API key for accessing NIM models. Get one at https://build.nvidia.com
  • NVIDIA_NIM_BASE_URL env
    Base URL for self-hosted NIM endpoints
  • NVIDIA_AI_FOUNDATION_URL env
    Base URL for NVIDIA AI Foundation Models (free tier available)
  • DEFAULT_MODEL env
    Default model to use for chat/text generation
  • ENABLE_IMAGE_GENERATION env
    Enable image generation tools
  • ENABLE_VISION env
    Enable vision/image analysis tools
  • ENABLE_MULTIMODAL env
    Enable multimodal tools

Descriptions are as written by the maker.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
294/wk
Connection
Runs on your computer
Latest versioni
2.1.2
Published to registryi
Jun 26, 2026
Code last changedi
Aug 18, 2026
Maker
david-eve-za
Packages
npm: nvidia-nim-mcp
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast

All apps, with pros and cons →

Related guides

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 19, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified with the GitHub account david-eve-za, which owns the repo

  • ✓ Pass

    Still maintained

    Code last changed 3 months ago

  • ✓ Pass

    Has a licence

    Uses MIT

  • – Not applicable

    Endpoint responds

    This one runs on your computer; there is no internet endpoint

  • – Not applicable

    Sign-in with OAuth

    Runs on your computer and uses local settings instead

  • … Not checked yet

    No hidden instructions in tool descriptions

    Runs on your computer; we can only read tool lists from internet endpoints

Published vulnerabilities (OSV.dev)

No entries on OSV.dev for nvidia-nim-mcp@2.1.2

Checks only this package version, not every dependency · checked Nov 16, 2026

What we check → · JSON

Makers: ask for a re-check or report wrong info
For makers: add a badge to your README

If you made this, paste this code into your README. The badge links back to this page.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/david-eve-za-nvidia-nim-mcp.svg)](https://mcp.popnx.com/en/servers/david-eve-za-nvidia-nim-mcp)

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Search & AI memoryi

  • More stars than 76% of the other 6394 servers in this category
  • Published to the registry more recently than 16% of the other 6394 servers in this category
  • Basic checks equal to or better than 99% of the other 6394 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Nvidia Nim MCP safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: NVIDIA_API_KEY

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed 3 months ago, and the latest version (2.1.2) reached the registry 5 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js on your computer.

What can I use instead?

In the same category: OpenSEO, Exa, Microsoft Learn MCP, Docs, COTAL actions (cotal.ai)

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

OpenSEO

Keyword research, site audits, rank tracking and AI visibility for your AI agent.

by every-appWidely used★ 28.2KUpdated 5 days ago

Runs in the cloud✓ everyapp.com

Exa

Connect AI agents to Exa for web search, content fetching, and multi-step research.

by exa-labsWidely used★ 5.2KUpdated 2 months ago

Runs in the cloud✓ service owner · exa.aiTried by the PopNx team

Microsoft Learn MCP

Official Microsoft Learn MCP Server – real-time, trusted docs & code samples for AI and LLMs.

by MicrosoftDocsWidely used★ 2KUpdated 12 months ago

Runs in the cloud✓ service owner · microsoft.comTried by the PopNx team

Docs

Search and read Empryo's documentation. Read-only, no auth, no local access.

by proxysoulGrowing★ 1.6KUpdated 2 months ago

Runs in the cloud✓ empryo.com
Compared with similar ones
This one
Nvidia Nim MCP
OpenSEOExaMicrosoft Learn MCPDocsCOTAL actions (cotal.ai)
Runs whereInstalls on your computerRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to install
Needs a keyYesNoNoNoNoNo
Add with + in ClaudeNoYesYesYesNoNo
Basic checks3/35/52/44/44/44/4
LicenseMITMITMITCC-BY-4.0NOASSERTIONApache-2.0
PriceNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registry

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

NVIDIA NIM MCP Server

A production-ready Model Context Protocol (MCP) server for consuming NVIDIA NIM (NVIDIA Inference Microservices) models. Supports 50+ LLMs, multimodal models, image generation, embeddings, reranking, function calling, vision, and code-specialized models with rich metadata for intelligent agent selection.


🚀 Features

  • 10 MCP Tools: chat completion, text generation, embeddings, reranking, function calling, model listing, model info, image generation, image analysis, multimodal tasks, model comparison
  • 50+ Supported Models: Llama 3.1/3.2, Nemotron 3 Ultra (550B), MiniMax M3, Kimi K2.6 (1T), DeepSeek V4 Pro, GLM 5.1, Qwen 3.5 397B, Mistral Large 3 (675B), GPT-OSS 120B, DiffusionGemma, FLUX.1, SDXL, SD3, and more
  • Rich Model Metadata: licensing, hardware requirements, benchmarks, image generation specs, reasoning modes, tags for agent selection
  • Advanced Filtering: by commercial use, reasoning, vision, function calling, multimodal, context length, tags, hardware
  • Production-Grade: automatic retries with exponential backoff, per-minute rate limiting, structured JSON logging
  • Type-Safe: full TypeScript, Zod input validation on every tool
  • Docker-Ready: multi-stage Dockerfile with non-root user, health checks
  • Configurable: all settings via environment variables
  • Single Required Env: Only NVIDIA_API_KEY required; all others have sensible defaults

📋 Prerequisites

  • Node.js 18+ (for NPM installation) or Docker (for container deployment)
  • A NVIDIA NGC API key (nvapi-...)

⚙️ Installation

Option 1: NPM Global Installation (Recommended)
# Install globally

npm install -g nvidia-nim-mcp

Run directly

nvidia-nim-mcp

Option 2: NPM Local Installation
# Initialize your project

npm init -y

Install locally

npm install nvidia-nim-mcp

Run with npx

npx nvidia-nim-mcp

Option 3: From Source
# Clone / download the project

cd nvidia-nim-mcp

Install dependencies

npm install

Build TypeScript

npm run build

Option 4: Docker
# Pull from Docker Hub (when published)

docker pull nvidia-nim-mcp

Or build locally

docker build -t nvidia-nim-mcp .


🔑 Configuration

Copy .env.example to .env and fill in your API key:

cp .env.example .env

Only `NVIDIA_API_KEY` is required — all other variables have production-ready defaults:

VariableRequiredDefaultDescription
NVIDIA_API_KEY✅—Your NVIDIA NGC API key
NVIDIA_NIM_BASE_URL❌https://integrate.api.nvidia.com/v1Base URL for NIM API
DEFAULT_MODEL❌black-forest-labs/flux.1-devDefault model (best image generation)
MAX_REQUESTS_PER_MINUTE❌40Rate limit cap (NVIDIA API limit)
MAX_TOKENS_PER_REQUEST❌4096Hard cap on tokens per request
REQUEST_TIMEOUT_MS❌120000Request timeout (ms)
MAX_RETRIES❌3Max retry attempts on failure
RETRY_DELAY_MS❌1000Base delay between retries (ms)
LOG_LEVEL❌info`error\warn\info\debug`
ENABLE_IMAGE_GENERATION❌trueEnable image generation tools
ENABLE_VISION❌trueEnable vision/multimodal tools
ENABLE_MULTIMODAL❌trueEnable multimodal task tools

🚀 Running

NPM Global Installation
# Run the server

nvidia-nim-mcp

With custom environment variables

NVIDIA_API_KEY=nvapi-your-key LOG_LEVEL=debug nvidia-nim-mcp

NPM Local Installation
# Run with npx

npx nvidia-nim-mcp

Or add to package.json scripts

"scripts": { "start": "nvidia-nim-mcp" }

npm start

From Source
# Development mode with auto-reload

npm run dev

Production mode (compiled)

npm run build && npm start

Docker
# Run with environment variables

docker run --rm \ -e NVIDIA_API_KEY=nvapi-your-key \ -e LOG_LEVEL=info \ nvidia-nim-mcp

Run in background with port mapping (if needed)

docker run -d \ --name nvidia-nim-mcp \ -e NVIDIA_API_KEY=nvapi-your-key \ nvidia-nim-mcp

Standalone Executable
# Make executable (if not already)

chmod +x dist/index.js

Run directly

./dist/index.js

With environment variables

NVIDIA_API_KEY=nvapi-your-key ./dist/index.js


🔧 MCP Client Configuration

For Global NPM Installation
{

"mcpServers": { "nvidia-nim": { "command": "nvidia-nim-mcp", "env": { "NVIDIA_API_KEY": "nvapi-your-key-here", "LOG_LEVEL": "info" } } } }

For Local NPM Installation
{

"mcpServers": { "nvidia-nim": { "command": "npx", "args": ["nvidia-nim-mcp"], "env": { "NVIDIA_API_KEY": "nvapi-your-key-here", "LOG_LEVEL": "info" } } } }

For Direct Executable Path
{

"mcpServers": { "nvidia-nim": { "command": "node", "args": ["/absolute/path/to/nvidia-nim-mcp/dist/index.js"], "env": { "NVIDIA_API_KEY": "nvapi-your-key-here", "LOG_LEVEL": "info" } } } }


🛠️ Available Tools

chat_completion

Multi-turn conversation with any NIM LLM.

{

"model": "nvidia/nemotron-3-ultra-550b-a55b", "messages": [ { "role": "user", "content": "Explain quantum computing" } ], "temperature": 0.3, "max_tokens": 4096 }

text_generation

Single-prompt text generation (simplified interface).

{

"prompt": "Write a haiku about machine learning", "temperature": 0.5, "max_tokens": 512 }

create_embeddings

Convert text(s) to vector embeddings for RAG/search.

{

"model": "nvidia/nv-embed-v1", "input": ["NVIDIA makes GPUs", "AI runs on GPUs"], "truncate": "END" }

rerank_passages

Rerank passages by relevance to a query.

{

"query": "What is CUDA?", "passages": ["CUDA is a GPU programming platform", "NIM serves AI models"], "top_k": 3 }

function_calling

Use NIM models with tool/function calling.

{

"model": "z-ai/glm-5.1", "messages": [{ "role": "user", "content": "What's the weather in Paris?" }], "tools": [{ "type": "function", "function": { "name": "get_weather", "description": "Get current weather", "parameters": { "type": "object", "properties": { "city": { "type": "string" } }, "required": ["city"] } } }] }

generate_image

Generate images from text prompts using FLUX.1, SDXL, SD3, DiffusionGemma.

{

"model": "black-forest-labs/flux.1-dev", "prompt": "A photorealistic mountain landscape at sunset, 8K", "width": 1024, "height": 1024, "steps": 30, "cfg_scale": 3.5, "sampler": "euler_a", "scheduler": "simple" }

analyze_image

Analyze and describe images using vision/multimodal models.

{

"model": "moonshotai/kimi-k2.6", "image_url": "https://example.com/image.jpg", "prompt": "Describe this image in detail", "detail": "high" }

multimodal_task

Perform multimodal tasks combining text and images.

{

"model": "minimaxai/minimax-m3", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Analyze this chart" }, { "type": "image_url", "image_url": { "url": "https://example.com/chart.png" } } ] } ], "max_tokens": 2048 }

list_models

List available models with rich metadata and advanced filtering.

{

"category": "code", "commercial_use": true, "supports_reasoning": true, "tags": ["coding", "agentic"], "include_details": true }

Filter Options:

  • category: language, embedding, reranking, vision, code, multimodal, image_generation, all
  • commercial_use: Filter by commercial license
  • supports_reasoning: Filter by reasoning capability
  • supports_vision: Filter by vision capability
  • supports_function_calling: Filter by function calling
  • supports_multimodal: Filter by multimodal input
  • min_context_length: Minimum context window (tokens)
  • tags: Filter by use case tags
  • hardware: Filter by GPU type (Hopper, Blackwell, Ampere)
  • include_details: Include full metadata (benchmarks, image specs, etc.)
get_model_info

Get complete metadata for a specific model.

{ "model_id": "nvidia/nemotron-3-ultra-550b-a55b" }

Returns: licensing, hardware requirements, benchmarks, image gen specs, reasoning modes, tags, supported languages, etc.

compare_models

Compare 2-5 models side-by-side across all decision factors.

{

"model_ids": [ "nvidia/nemotron-3-ultra-550b-a55b", "deepseek-ai/deepseek-v4-pro", "moonshotai/kimi-k2.6", "z-ai/glm-5.1" ] }

Returns: Structured comparison table with licensing, hardware, benchmarks, capabilities, tags, image generation specs, etc.


📦 Supported Models (50+)

Language Models (Frontier Reasoning)
ModelParametersContextLicenseCommercialBest For
nvidia/nemotron-3-ultra-550b-a55b550B (55B active)131KOpenMDW-1.1✅Frontier reasoning, coding, agentic, 1M context, multilingual
nvidia/nemotron-3-ultra-550b-a55b-instruct550B131KOpenMDW-1.1✅Instruction-tuned variant
minimaxai/minimax-m3428B (22B active)1MNon-Commercial❌Multimodal, video (30min), 8hr coding, agentic
moonshotai/kimi-k2.61T (32B active)256KModified MIT✅Long-horizon coding, 300 agents, vision, agentic
deepseek-ai/deepseek-v4-pro1.6T (49B active)1MMIT✅Advanced coding, math, reasoning, 3 reasoning modes
z-ai/glm-5.1754B (DSA)131KMIT✅Software engineering, agentic, SWE-Bench 58.4%
qwen/qwen3.5-397b-a17b397B (MoE)131KResearch❌Large-scale multilingual, multimodal
mistralai/mistral-large-3-675b-instruct-2512675B131KResearch❌Frontier reasoning, multimodal
openai/gpt-oss-120b120B131KApache 2.0✅Open-weight, research, fine-tuning
google/diffusiongemma-26b-a4b-it25.2B (3.8B active)256KApache 2.0✅Diffusion text gen, 35+ langs, fast, multimodal
Code-Specialized Models
ModelParametersContextLicenseCommercial
z-ai/glm-5.1754B131KMIT✅
z-ai/glm5-128KZ.ai✅
qwen/qwen2.5-coder-32b-instruct32B131KResearch❌
Multimodal / Vision Models
ModelParametersContextVisionVideoLicenseCommercial
meta/llama-3.2-90b-vision-instruct90B128K✅❌Llama 3.2✅
meta/llama-3.2-11b-vision-instruct11B128K✅❌Llama 3.2✅
nvidia/neva-22b22B4K✅❌NVIDIA✅
microsoft/phi-3.5-vision-instruct-128K✅❌MIT✅
minimaxai/minimax-m3428B1M✅✅ (30min)Non-Commercial❌
moonshotai/kimi-k2.61T256K✅✅Modified MIT✅
Image Generation Models
ModelArchitectureResolutionsAspect RatiosMax ImagesControlNetLicenseCommercial
black-forest-labs/flux.1-devDiffusion Transformer1024², 1152×896, 1344×768, 21:91:1, 16:9, 9:16, 4:3, 3:4, 21:91Canny, DepthApache 2.0*❌*
black-forest-labs/flux.1-kontext-devDiffusion TransformerSameSame1-Apache 2.0*❌*
nvidia/stable-diffusion-xlUNet + Attention1024², 1152×896, 1216×8321:1, 16:9, 9:16, 4:3, 3:44-SDXL 1.0✅**
stabilityai/sd-3-mediumSD3SameSame2-Stability AI✅**
nvidia/sdxl-turboADD512², 1024²1:14-SDXL 1.0✅**

*\*Non-commercial default; commercial via contact* **\*\*Requires Stability AI membership**

Embedd

Only the beginning is shown; read the rest in the repo