Onde Inference CLI: Fine-tune & Deploy Local LLMs

Name: Onde Inference CLI: Fine-tune & Deploy Local LLMs
Author: ondeinference

by ondeinferenceversion 0.5.1i★ 5iRuns on your computer

Registry nameio.github.ondeinference/onde-cli

How to install

Overview

Description from the maker (original English)

MCP server to fine-tune LoRA, export GGUF, and deploy local LLMs on Onde Inference.

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs on your computer
Transport: stdio
Category: Developer tools

Install

Pick the AI app you use, then copy the settings.

Passed 2/2 checks · Runs on your computer

First: which AI do you use?

ClaudeWeb · app · phoneChatGPTWebClaude CodeTerminalCursorCode editorVS CodeCode editorOtherOther apps

Pick your app and the steps appear below.

Works with Claude, with some setup first

Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Install Node.js
One time only; it works for every server that needs Node.js
Open the Node.js download page ↗
Done
Open the Claude desktop app’s settings file
SettingsDeveloperEdit Config
Done

Paste these settings and save the file

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli",
        "--mcp",
        "your-value"
      ]
    }
  }
}

Done

Quit Claude and open it again
Done
Try it
Use Onde Inference CLI: Fine-tune & Deploy Local LLMs and tell me what you can do for me, then show me one thing
✓ If Claude says it is using Onde Inference CLI: Fine-tune & Deploy Local LLMs or shows a Onde Inference CLI: Fine-tune & Deploy Local LLMs tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Onde Inference CLI: Fine-tune & Deploy Local LLMs yet

Onde Inference CLI: Fine-tune & Deploy Local LLMs runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Onde Inference CLI: Fine-tune & Deploy Local LLMs

Steps for Claude →Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
Steps for Claude Code →Install Node.js on your computer first (one time)
Steps for Cursor →Install Node.js on your computer first (one time) · No one-click button: paste the settings and fill in the values yourself
Steps for VS Code →Install Node.js on your computer first (one time) · No one-click button: paste the settings and fill in the values yourself

B · Others in Developer tools that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Sentry✓ ChatGPT
Front-End Checklist✓ ChatGPT
Compiler Explorer✓ ChatGPT

Works with Claude Code, with some setup first

Install Node.js on your computer first (one time)

Install Node.js
One time only; it works for every server that needs Node.js
Open the Node.js download page ↗
Done
Open Terminal
Mac: press Command+Space and type Terminal · Windows: open PowerShell
Done

Paste this command and press Enter

claude mcp add onde-cli -- npx -y @ondeinference/cli --mcp your-value

Done

Type /mcp in Claude Code
You should see Onde Inference CLI: Fine-tune & Deploy Local LLMs listed as connected
Done
Try it
Use Onde Inference CLI: Fine-tune & Deploy Local LLMs and tell me what you can do for me, then show me one thing
✓ If Claude Code says it is using Onde Inference CLI: Fine-tune & Deploy Local LLMs or shows a Onde Inference CLI: Fine-tune & Deploy Local LLMs tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

Install Node.js on your computer first (one time) · No one-click button: paste the settings and fill in the values yourself

Install Node.js
One time only; it works for every server that needs Node.js
Open the Node.js download page ↗
Done

Open Cursor’s MCP settings file

~/.cursor/mcp.json

Paste these settings, fill in the empty values and save

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli",
        "--mcp",
        "your-value"
      ]
    }
  }
}

Done

Open the AI chat in Cursor in Agent mode
Done
Try it
Use Onde Inference CLI: Fine-tune & Deploy Local LLMs and tell me what you can do for me, then show me one thing
✓ If Cursor says it is using Onde Inference CLI: Fine-tune & Deploy Local LLMs or shows a Onde Inference CLI: Fine-tune & Deploy Local LLMs tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

Install Node.js on your computer first (one time) · No one-click button: paste the settings and fill in the values yourself

Install Node.js
One time only; it works for every server that needs Node.js
Open the Node.js download page ↗
Done

Open VS Code’s MCP settings file

MCP: Open User Configuration

Paste these settings, fill in the empty values and save

{
  "servers": {
    "onde-cli": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli",
        "--mcp",
        "your-value"
      ]
    }
  }
}

Done

Open the AI chat in VS Code in Agent mode
Done
Try it
Use Onde Inference CLI: Fine-tune & Deploy Local LLMs and tell me what you can do for me, then show me one thing
✓ If VS Code says it is using Onde Inference CLI: Fine-tune & Deploy Local LLMs or shows a Onde Inference CLI: Fine-tune & Deploy Local LLMs tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Onde Inference CLI: Fine-tune & Deploy Local LLMs💬 Discussion →

For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add onde-cli -- npx -y @ondeinference/cli --mcp your-value

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli",
        "--mcp",
        "your-value"
      ]
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli",
        "--mcp",
        "your-value"
      ]
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "onde-cli": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli",
        "--mcp",
        "your-value"
      ]
    }
  }
}

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

GitHub stars i: 5
Downloads per weeki: 47/wk
Licence i: No licence stated
Connection: Runs on your computer
Transport: stdio
Latest versioni: 0.5.1
Categoryi: Developer tools
Published to registryi: Nov 10, 2026
Code last changedi: Nov 10, 2026
Maker: ondeinference
Packages: npm: @ondeinference/cli
nuget: Onde.Cli
Repo: ondeinference/onde-cli
Website: ondeinference.com
Registry status: Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

Claude Goose LM Studio Msty Studio Cherry Studio Cursor VS Code + GitHub Copilot Visual Studio Windsurf (Devin Desktop)Zed Kiro Cline Continue JetBrains AI Assistant Claude Code Codex CLI Gemini CLI OpenCode nodecode Warp LibreChat Raycast

All apps, with pros and cons →

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 11, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account ondeinference, which owns the repo
✓ Pass
Still maintained
Code last changed yesterday
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
– Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
– Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
… Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

User reviews

No reviews yet

Compared with others in Developer toolsi

More stars than 85% of the other 5751 servers in this category
Published to the registry more recently than 94% of the other 5751 servers in this category
Basic checks equal to or better than 100% of the other 5751 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Onde Inference CLI: Fine-tune & Deploy Local LLMs safe?

It passed 2 of 2 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed yesterday, and the latest version (0.5.1) reached the registry yesterday.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js, .NET on your computer.

What can I use instead?

In the same category: REA, Netdata, Front-End Checklist

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

REA

Reverse engineer anything from your terminal or agent with one CLI and MCP server.

by morlutoWidely used↓ 388.7K/wk★ 448.2KUpdated 17 days ago

Runs on your computer

Install

Netdata

Real-time infrastructure monitoring with metrics, logs, alerts, and ML-based anomaly detection.

by netdataWidely used★ 81.3KUpdated 6 days ago

Runs in the cloud

Install

Front-End Checklist

Review frontend code and live pages against 386 quality-gated web development rules.

by thedaviddiasWidely used★ 74.7KUpdated 37 days ago

Runs in the cloud

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

Onde Inference CLI

Command-line interface for Onde Inference .

Swift · Flutter · React Native · Rust · Website

Manage your Onde Inference account, fine-tune local models, and export them to GGUF, all from the terminal.

Install

Install onde-cli with your favorite tool. For package docs and the full install matrix, see https://ondeinference.com/cli.

npm

npm install -g @ondeinference/cli

Homebrew

brew tap ondeinference/homebrew-tap && brew trust --tap ondeinference/homebrew-tap

brew install onde

pip / uv / uvx

pip install onde-cli

or

uv tool install onde-cli uv run onde --tui

or with

uvx --from onde-cli onde --tui

.NET tool

dotnet tool install --global Onde.Cli

Dart pub global

dart pub global activate onde_cli

The Dart package is a thin launcher. On first run it downloads the right native binary into ~/.onde/cli, then reuses the local copy.

Pre-built binary

Download a release from GitHub Releases:

# macOS Apple Silicon

curl -Lo onde https://github.com/ondeinference/onde-cli/releases/latest/download/onde-macos-arm64 chmod +x onde && mv onde /usr/local/bin/onde

Platform	File
macOS Apple Silicon	`onde-macos-arm64`
macOS Intel	`onde-macos-amd64`
Linux x64	`onde-linux-amd64`
Linux arm64	`onde-linux-arm64`
Windows x64	`onde-win-amd64.exe`
Windows arm64	`onde-win-arm64.exe`

Usage

onde --tui

This opens the TUI. Plain onde prints usage and exits. You can sign up or sign in right there.

Key	What it does
`Tab`	Move between fields
`Enter`	Submit or sign out
`Ctrl+L`	Go to the sign-in screen
`Ctrl+N`	Go to the new account screen
`Ctrl+C`	Quit

MCP server

Run onde as a Model Context Protocol server over stdio instead of the TUI:

onde --mcp

This exposes Onde account and model-catalog operations as MCP tools — login, me, apps_list, app_create, app_rename, models_list, model_register, model_assign, hf_search — returning structured JSON. stdout is the JSON-RPC channel; tools run non-interactively and reuse the token from a TUI sign-in (or the login tool). Point any MCP client at the command onde --mcp.

Fine-tuning

onde includes a LoRA fine-tuning pipeline for Qwen2, Qwen2.5, and Qwen3 models. It runs locally: Metal on Apple Silicon, CPU elsewhere. No cloud setup. No Python environment.

The flow is straightforward: download a safetensors base model, fine-tune it with LoRA, merge the adapter back into the base weights, then export to GGUF for use in the Onde SDK.

If you want a quick refresher on what the model is actually doing at inference time, Onde has a short note on the forward pass.

Training data format

Each line should be one complete conversation in Qwen's chat template:

{"text": "<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n<|im_start|>user\nWhat is LoRA?<|im_end|>\n<|im_start|>assistant\nLoRA adds small trainable matrices to frozen layers, letting you fine-tune large models without updating all the weights.<|im_end|>"}

Save the file wherever you want. The TUI lets you point to it directly.

Running it

onde --tui

→ Models tab (Tab from Apps) → Select a safetensors model (↑↓, Enter) → Press f

Only safetensors models can be fine-tuned. GGUF models are already quantized, so their weights are not differentiable.

Configure the run:

Field	Default	Notes
Training data	`~/.onde/finetune/train.jsonl`	Path to your JSONL file
LoRA rank	`8`	Higher means more capacity and more memory use
Epochs	`3`	Full passes over the dataset
Learning rate	`0.0001`	AdamW default

Press Enter to start. In a healthy run, loss usually starts dropping by epoch 2. If it stays flat, try 0.0003.

After training

For rank 8 on a 0.6B model, the adapter is about 1.5 MB. From the fine-tune complete screen:

m to merge the adapter into the base model
g to export the merged model to GGUF

The resulting GGUF loads directly in the Onde SDK for on-device AI inference.

Supported base models

Model	Size	Notes
`Qwen/Qwen3-0.6B`	~1.2 GB	Smallest and quickest to train
`Qwen/Qwen2.5-1.5B-Instruct`	~3.0 GB	Good default for instruction tuning
`Qwen/Qwen3-1.7B`	~3.4 GB	Newer small Qwen3 model
`Qwen/Qwen3-4B`	~8.0 GB	Best quality, better suited to macOS

You can search for any of these from the Models tab with /.

Debug

Logs are written to ~/.cache/onde/debug.log.

If you installed through pub.dev, the launcher cache lives under ~/.onde/cli.

License

Dual-licensed under MIT and Apache 2.0.

Onde Inference CLI: Fine-tune & Deploy Local LLMs

Overview

What you can do with it

Install

Install Node.js

Open the Claude desktop app’s settings file

Paste these settings and save the file

Quit Claude and open it again

Try it

What you can do instead

Install Node.js

Open Terminal

Paste this command and press Enter

Type /mcp in Claude Code

Try it

Install Node.js

Open Cursor’s MCP settings file

Open the AI chat in Cursor in Agent mode

Try it

Install Node.js

Open VS Code’s MCP settings file

Open the AI chat in VS Code in Agent mode

Try it

Installed on your computer

At a glance

Which apps can use it

Related guides

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Discussion

User reviews

Compared with others in Developer toolsi

Common questions

Alternatives

REA

Netdata

Front-End Checklist

README from the maker

Install

npm

Homebrew

pip / uv / uvx

or

or with

.NET tool

Dart pub global

Pre-built binary

Usage

MCP server

Fine-tuning

Training data format

Running it

After training

Supported base models

Debug

License

Copyright