Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words

Isaac Sim robot workbench

by Milokuciaversion 0.1.2i★ 0iRuns on your computerRepository ↗
Registry nameio.github.Milokucia/dex-isaac-mcp

How to install

What it does

Drive a live Isaac Sim session: any robot, poses, gain tuning, range tests, Isaac Lab training.

  • Connects Runs on your computer
  • Account or key No key needed · 1 setting to fill in (ISAAC_MCP_HOME)
  • Category Crypto & blockchain

Why it ranks here

Lists are ordered by a usage score (out of 100) built from these parts

Popularity0/80GitHub stars or weekly downloads: the larger counts 60, the smaller 20
Freshness7/12Full marks for a release or code change within 30 days
Still answering0/8The cloud endpoint answered at the last check
Usage score7/100

Quality: Passed 3/3 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)

Install

Pick the AI app you use, then copy the settings.

Let your AI install it with one sentence

Please install Isaac Sim robot workbench. Follow https://mcp.popnx.com/i/milokucia-dex-isaac-mcp.md, show me the commands and wait for my OK before running them.

Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads

Passed 3/3 checks · Runs on your computer · ✓ Commands checked Nov 14, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude, with some setup first

1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Let AI install it

Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Isaac Sim robot workbench for Claude on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "dex-isaac": { "command": "uvx", "args": [ "dex-isaac-mcp" ], "env": { "ISAAC_MCP_HOME": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For ISAAC_MCP_HOME, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Isaac Sim robot workbench tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • ISAAC_MCP_HOME Path to a clone of github.com/Milokucia/dex-isaac-mcp; the Isaac Sim daemon runs from its docker/ directory

    Descriptions are as written by the maker.

  3. Open the Claude desktop app’s settings file

    SettingsDeveloperEdit Config

  4. Paste these settings and save the file

    {
      "mcpServers": {
        "dex-isaac": {
          "command": "uvx",
          "args": [
            "dex-isaac-mcp"
          ],
          "env": {
            "ISAAC_MCP_HOME": "your-value"
          }
        }
      }
    }
  5. Quit Claude and open it again

  6. Try it

    Use Isaac Sim robot workbench and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using Isaac Sim robot workbench or shows a Isaac Sim robot workbench tool in the answer, you are connected

1 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • ISAAC_MCP_ROBOT Robot config JSON that sim_up loads by default (container path)

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Isaac Sim robot workbench yet

Isaac Sim robot workbench runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Isaac Sim robot workbench

  • 1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
  • 1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time)
  • 1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time)
  • 1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time)

B · Others in Crypto & blockchain that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Works with Claude Code, with some setup first

1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Isaac Sim robot workbench for Claude Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user dex-isaac --env ISAAC_MCP_HOME=your-value -- uvx dex-isaac-mcp 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For ISAAC_MCP_HOME, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Isaac Sim robot workbench tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • ISAAC_MCP_HOME Path to a clone of github.com/Milokucia/dex-isaac-mcp; the Isaac Sim daemon runs from its docker/ directory

    Descriptions are as written by the maker.

  3. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  4. Paste this command and press Enter

    claude mcp add --scope user dex-isaac --env ISAAC_MCP_HOME=your-value -- uvx dex-isaac-mcp
  5. Type /mcp in Claude Code

    You should see Isaac Sim robot workbench listed as connected

  6. Try it

    Use Isaac Sim robot workbench and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using Isaac Sim robot workbench or shows a Isaac Sim robot workbench tool in the answer, you are connected

1 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • ISAAC_MCP_ROBOT Robot config JSON that sim_up loads by default (container path)

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Isaac Sim robot workbench for Cursor on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "dex-isaac": { "command": "uvx", "args": [ "dex-isaac-mcp" ], "env": { "ISAAC_MCP_HOME": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For ISAAC_MCP_HOME, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Isaac Sim robot workbench tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • ISAAC_MCP_HOME Path to a clone of github.com/Milokucia/dex-isaac-mcp; the Isaac Sim daemon runs from its docker/ directory

    Descriptions are as written by the maker.

  3. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  4. Fill in your key

    In the Isaac Sim robot workbench settings, ISAAC_MCP_HOME is empty; add your key and save

  5. Open the AI chat in Cursor in Agent mode

  6. Try it

    Use Isaac Sim robot workbench and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using Isaac Sim robot workbench or shows a Isaac Sim robot workbench tool in the answer, you are connected

1 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • ISAAC_MCP_ROBOT Robot config JSON that sim_up loads by default (container path)

Descriptions are as written by the maker.

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

1 setting(s) to fill in (ISAAC_MCP_HOME) · Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Isaac Sim robot workbench for VS Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "dex-isaac": { "type": "stdio", "command": "uvx", "args": [ "dex-isaac-mcp" ], "env": { "ISAAC_MCP_HOME": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For ISAAC_MCP_HOME, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Isaac Sim robot workbench tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Fill in 1 setting(s)

    These are program settings, not keys. No sign-up needed; fill them in as the maker describes.

    • ISAAC_MCP_HOME Path to a clone of github.com/Milokucia/dex-isaac-mcp; the Isaac Sim daemon runs from its docker/ directory

    Descriptions are as written by the maker.

  3. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  4. Fill in your key

    In the Isaac Sim robot workbench settings, ISAAC_MCP_HOME is empty; add your key and save

  5. Open the AI chat in VS Code in Agent mode

  6. Try it

    Use Isaac Sim robot workbench and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using Isaac Sim robot workbench or shows a Isaac Sim robot workbench tool in the answer, you are connected

1 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • ISAAC_MCP_ROBOT Robot config JSON that sim_up loads by default (container path)

Descriptions are as written by the maker.

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Isaac Sim robot workbench💬 Discussion →
For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add --scope user dex-isaac --env ISAAC_MCP_HOME=your-value -- uvx dex-isaac-mcp

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "dex-isaac": {
      "command": "uvx",
      "args": [
        "dex-isaac-mcp"
      ],
      "env": {
        "ISAAC_MCP_HOME": "your-value"
      }
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "dex-isaac": {
      "command": "uvx",
      "args": [
        "dex-isaac-mcp"
      ],
      "env": {
        "ISAAC_MCP_HOME": "your-value"
      }
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "dex-isaac": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "dex-isaac-mcp"
      ],
      "env": {
        "ISAAC_MCP_HOME": "your-value"
      }
    }
  }
}

Values you fill in

  • ISAAC_MCP_HOME required env
    Path to a clone of github.com/Milokucia/dex-isaac-mcp; the Isaac Sim daemon runs from its docker/ directory
  • ISAAC_MCP_ROBOT env
    Robot config JSON that sim_up loads by default (container path)

Descriptions are as written by the maker.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
80/wk
Connection
Runs on your computer
Latest versioni
0.1.2
Published to registryi
Oct 4, 2026
Code last changedi
Oct 8, 2026
Maker
Milokucia
Packages
pypi: dex-isaac-mcp
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast

All apps, with pros and cons →

Related guides

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 19, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified with the GitHub account Milokucia, which owns the repo

  • ✓ Pass

    Still maintained

    Code last changed 42 days ago

  • ✓ Pass

    Has a licence

    Uses MIT

  • – Not applicable

    Endpoint responds

    This one runs on your computer; there is no internet endpoint

  • – Not applicable

    Sign-in with OAuth

    Runs on your computer and uses local settings instead

  • … Not checked yet

    No hidden instructions in tool descriptions

    Runs on your computer; we can only read tool lists from internet endpoints

Published vulnerabilities (OSV.dev)

No entries on OSV.dev for dex-isaac-mcp@0.1.2

Checks only this package version, not every dependency · checked Nov 16, 2026

What we check → · JSON

Makers: ask for a re-check or report wrong info
For makers: add a badge to your README

If you made this, paste this code into your README. The badge links back to this page.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/milokucia-dex-isaac-mcp.svg)](https://mcp.popnx.com/en/servers/milokucia-dex-isaac-mcp)

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Crypto & blockchaini

  • More stars than 0% of the other 1759 servers in this category
  • Published to the registry more recently than 49% of the other 1759 servers in this category
  • Basic checks equal to or better than 99% of the other 1759 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Isaac Sim robot workbench safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed 42 days ago, and the latest version (0.1.2) reached the registry 2 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Python (uv) on your computer.

What can I use instead?

In the same category: DexSQL, PayRam, DexPaprika, Alchemy MCP Server, X402 List MCP

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

DexSQL

SQL for Android APK and DEX files: classes, methods, strings, references and smali.

by LSPosedGrowing★ 320Updated 32 days ago

Runs on your computer✓ lsposed.org

PayRam

Install, configure, operate and integrate self-hosted PayRam crypto payment gateways.

by PayRamGrowing★ 158Updated 43 days ago

Runs in the cloud✓ service owner · payram.com

DexPaprika

DEX and on-chain data: liquidity pools, token prices, swaps, and trading volume.

by coinpaprikaGrowing★ 120Updated 6 days ago

Runs in the cloud✓ service owner · dexpaprika.com

X402 List MCP

Find and vet x402 payment APIs before your agent pays one: uptime, price, on-chain volume.

by mcccsmEarly↓ 80/wk★ 18Updated 40 days ago

Computer or cloud✓ service owner · x402-list.com
Compared with similar ones
This one
Isaac Sim robot workbench
DexSQLPayRamDexPaprikaAlchemy MCP ServerX402 List MCP
Runs whereInstalls on your computerInstalls on your computerRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installCloud or install on your computer
Needs a keyNoNoNoNoNoNo
Add with + in ClaudeNoNoNoNoNoNo
Basic checks3/32/33/44/44/45/5
LicenseMITNOASSERTION–MITMITMIT
PriceNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registry

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

dex-isaac-mcp

*Recorded headless with the server's own tools (sim_frame_robot, sim_set_backdrop, sim_record_start), driving the Allegro hand example. Each caption is the request and the tool call it became.*

An MCP server that lets an AI agent (Claude Code, or any MCP client) drive a live, persistent Isaac Sim session and launch Isaac Lab training runs.

Kit takes tens of seconds to boot. If every experiment is a fresh launch, most of your time goes to waiting. Here Kit starts once inside a daemon and stays up. Each tool call lands in that running session, so changing a gain, stepping physics or taking a screenshot costs a frame, not a relaunch.

 MCP client ──stdio──▶ dex_isaac_mcp (host, plain python)

│ newline-delimited JSON over a Unix socket ▼ scripts/simd.py (Isaac Lab container, Kit stays up) └─ one articulation, described by a robot JSON

  • Any articulated robot. Point it at a USD and a small JSON config. Franka and Allegro examples are included.
  • Normalized joint control. Targets are 0..1, where 0 is a joint's lower limit and 1 its upper limit, so agents don't need to know radians or meters.
  • Named poses per robot (home, fist, …), which can be blended part-way.
  • Headless capture and GIF recording from an auto-framed camera, with captions. The clip above was made this way.
  • Props: spawn a table, a ball or a USD into the running scene and read back where they settle.
  • Measurements: joint state, per-joint travel and tracking error, a range test that finds blocked joints, and parameter sweeps inside one session.
  • Training control: each run is a detached docker compose run. You can poll its status, TensorBoard scalars, checkpoints and logs.

How it differs from other Isaac Sim MCP servers

NVIDIA's official Isaac Sim MCP is a documentation search for coding assistants, and works well alongside this one. Servers like isaacsim-mcp-server and omni-mcp/isaac-sim-mcp run inside the Isaac Sim GUI and cover scene building broadly. This one runs headless, as a daemon in Docker, and focuses on tuning, measuring and training one robot.

NVIDIA Isaac Sim MCPIn-GUI servers (isaacsim-mcp-server, omni-mcp)dex-isaac-mcp
What it isDocs and code searchKit extension inside a running Isaac SimExternal daemon; Kit stays up in a container
Controls the simulationNoYesYes
Headless / remote GPU boxn/aNeeds the GUIYes: headless capture, Docker, Unix socket
Scene building (lights, materials, sensors, asset library)n/aBroadMinimal: primitive and USD props
Robot setupn/aBuilt-in robot libraryAny USD plus a small JSON config (joints, poses, couplings, gains)
Measurementn/aJoint and prim stateRange tests that find blocked joints, tracking error, sweeps that restore the original value
Live tuningn/aNot documentedPD gains, effort, software mimic couplings
Isaac Lab trainingn/aNot documentedLaunch, poll, TensorBoard metrics, checkpoints, stop
Recordingn/aCamera capturesCaptioned GIFs from an auto-framed camera, headless
PlatformAnyWherever Isaac Sim runsLinux, NVIDIA GPU, Docker, NGC

Pick an in-GUI server to build a scene by talking to it, interactively, with a wide robot and asset library.

Pick this one to have an agent tune, debug and train a specific robot (your own, from a USD), unattended or on a remote box, with numbers it can act on instead of only screenshots.

Requirements

  • Linux with an NVIDIA GPU that Isaac Sim supports, plus the NVIDIA Container Toolkit
  • Docker with the Compose plugin
  • An NGC login to pull the Isaac Lab image: docker login nvcr.io (user $oauthtoken, password: your NGC API key)
  • Python ≥ 3.10 on the host, for the MCP server only

Quick start

git clone <this repo> dex-isaac-mcp && cd dex-isaac-mcp

1. Build the image (Isaac Lab 2.3.2 base, pinned by digest)

cd docker && docker compose build && cd ..

2. Install the host-side server, editable so it finds this clone

pip install -e . # add [metrics] for train_metrics: pip install -e '.[metrics]'

3. Register it with Claude Code

claude mcp add isaac -- python -m dex_isaac_mcp

4. Allow the container to open windows (once per login; needed for screenshots)

xhost +local:docker

Then ask the agent something like *"start the sim with the Franka, move it to ready and show me a screenshot."* It will call sim_up, sim_set_pose, sim_step and sim_screenshot.

From PyPI instead: pip install dex-isaac-mcp. The daemon still runs from a clone (it needs docker/ and scripts/simd.py), so point the server at it:

claude mcp add isaac -e ISAAC_MCP_HOME=/abs/path/dex-isaac-mcp -- dex-isaac-mcp

Other MCP clients can launch python -m dex_isaac_mcp (or the dex-isaac-mcp script) over stdio.

The first sim_up takes several minutes: Kit builds its shader cache and downloads Nucleus assets. Later starts are much faster.

Running the daemon by hand

sim_up deletes its container (--rm) when the daemon exits, so a crash on startup takes its traceback with it. To see the error, run the daemon in the foreground:

cd docker

docker compose run --rm simd scripts/simd.py --gui --robot examples/robots/franka.json docker compose run --rm simd scripts/simd.py --headless --usd /path/in/container/robot.usd docker compose run --rm simd scripts/simd.py --sliders --robot examples/robots/allegro_hand.json

--sliders opens an omni.ui panel with one slider per driven joint. The socket stays live alongside it.

Tools

Session
ToolWhat it does
sim_statusWhether the daemon is up, plus its robot, driven joints, poses, couplings and gains
sim_upStart the daemon container (robot, usd, gui, ground, extra_args) and wait until it answers. Does nothing if it is already up
sim_downStop the daemon
sim_reloadRestart with a different spawn property: robot, USD, pos_iters, self-collision
sim_resetUndo an experiment in a few frames: remove props, restore spawn gains and couplings, write joints and root back to their spawn state. ok=False means reload
Inspect
ToolWhat it does
sim_inspect_jointsA USD's articulation DOFs, its loop-closure joints (excluded from the articulation) and its articulation roots. Reads the file, so it shows edits saved from the GUI
sim_get_joint_statePositions and velocities, plus driven joints' normalized positions and limits
sim_get_statsPer-joint travel and mean tracking error since the last reset
sim_screenshotViewport capture, returned as an image. Needs gui=True
sim_set_cameraPoint the viewport camera
Drive
ToolWhat it does
sim_set_targetsNormalized targets, as a full vector or {joint: value}
sim_list_poses / sim_set_poseNamed poses from the robot config. amount blends toward a pose, starting from the lower limits or from the current targets
sim_stepAdvance N physics steps (default dt 1/120 s)
sim_playRun continuously, or pause
sim_waveSweep every driven joint through its range and return travel stats
sim_range_testDrive every joint from its lower limit toward a target and report the fraction of travel reached. Below 0.9 counts as blocked (self-collision, a binding linkage, too little effort)
Scene
ToolWhat it does
sim_spawn_objectAdd a prop to the live scene: cuboid, sphere, cylinder, capsule, cone or a USD file, with collision. static for a fixed table or wall, kinematic for a body contact cannot move
sim_list_objectsEvery prop's current world pose
sim_remove_objectDelete a prop
Capture and record

These work headless, with no GUI or viewport. They use a dedicated camera that is independent of the GUI view.

ToolWhat it does
sim_frame_robotAim the capture camera so the whole robot fills the frame, from a given direction. raise_frac leaves room for captions
sim_set_capture_cameraPlace the capture camera by hand
sim_set_backdropA plain colored panel behind the robot. Use it with ground=False for clean footage
sim_captureOne frame, returned as an image
sim_record_start / sim_record_caption / sim_record_stopRecord every Nth physics step, with a caption drawn on each frame, to an animated GIF under .cache/recordings/. Anything that steps the sim is recorded
Tune
ToolWhat it does
sim_set_paramsLive stiffness / damping / effort on the driven joints
sim_set_couplingLive software-mimic ratios, keyed by follower joint
sim_sweepTry several values of one live parameter (stiffness, damping, effort, coupling: ), running wave or range for each. Restores the original value afterwards. A diverging solver is recorded as a result rather than raised
Train
ToolWhat it does
train_startLaunch a headless training run in its own container and return at once. extra_args go to the script verbatim (e.g. Hydra overrides). device pins a GPU
train_listRunning and recent runs, and log directories holding checkpoints
train_statusContainer state, checkpoints and latest scalars
train_logsTail a running container's output
train_metricsList TensorBoard tags, or get a downsampled series for one tag
train_checkpointsCheckpoints with step and size
train_stopStop a run

Training runs do not depend on the daemon or on the MCP session. They keep going after the client disconnects.

Robot config

A robot is one JSON file. Only usd is required. Unknown keys are rejected, so a typo fails loudly instead of quietly falling back to a default.

{

"name": "franka", "usd": "{ISAACLAB_NUCLEUS_DIR}/Robots/FrankaEmika/panda_instanceable.usd", "fix_root_link": true, "spawn_pos": [0, 0, 0], "init_joint_pos": {"panda_joint4": -2.81, "panda_joint6": 3.04, ".*": 0.0}, "driven_joints": ["panda_joint[1-7]", "panda_finger_joint.*"], "passive_joints": [], "couplings": [{"leader": "joint_a", "follower": "joint_b", "ratio": 1.0}], "actuator": {"stiffness": 400, "damping": 40, "effort": 87, "velocity": null}, "solver": {"pos_iters": 32, "vel_iters": 4, "self_collisions": true}, "camera": {"eye": [1.8, 1.8, 1.4], "target": [0, 0, 0.4]}, "poses": {"ready": {"panda_joint[1357]": 0.5, "panda_finger_joint.*": 1.0}} }

KeyMeaning
usdLocal path (relative paths resolve from the JSON's own directory), a URL, or a path using {ISAAC_NUCLEUS_DIR} / {ISAACLAB_NUCLEUS_DIR}
init_joint_posSpawn pose in the joints' own units (rad / m), keyed by regex. It must lie inside every joint's limits or spawning fails. The default is all zeros, which is out of range for e.g. Franka's joint 4
driven_jointsRegexes (full match) for joints that take commands. Default .*
passive_jointsJoints whose angle is owned by a constraint, such as a closed-chain linkage. They get a zero-stiffness drive, because a live PD drive fights the constraint and the mechanism jitters

| couplings | Software mimic joints: follower target = ratio × leader target. They are

Only the beginning is shown; read the rest in the repo