Metrillm

Name: Metrillm
Author: MetriLLM

by MetriLLMversion 0.2.6i★ 8 (Stars for the whole repo)iRuns on your computer

Registry nameio.github.MetriLLM/metrillm

How to install

What it does

Benchmark local LLM models — speed, quality & hardware fitness verdict from any MCP client

Connects Runs on your computer
Account or key No key needed
Category Clinics & health

Install

Pick the AI app you use, then copy the settings.

Passed 3/3 checks · Runs on your computer · ✓ Commands checked Nov 13, 2026

First: which AI do you use?

ClaudeWeb · app · phoneChatGPTWebClaude CodeTerminalCursorCode editorVS CodeCode editorOtherOther apps

Pick your app and the steps appear below.

Works with Claude, with some setup first

Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Let AI install it

Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Metrillm for Claude on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "metrillm": { "command": "npx", "args": [ "-y", "metrillm-mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Metrillm tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

1
Install Node.js (if you don’t have it)
Already installed? Check first · Open Terminal, type this command and press Enter
node -v
- A version number such as v26.13.1 = installed, skip this step
- "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
How to open Terminal
Mac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Done
Open the Claude desktop app’s settings file
SettingsDeveloperEdit Config
Done

Paste these settings and save the file

{
  "mcpServers": {
    "metrillm": {
      "command": "npx",
      "args": [
        "-y",
        "metrillm-mcp"
      ]
    }
  }
}

Done

Quit Claude and open it again
Done
Try it
Use Metrillm and tell me what you can do for me, then show me one thing
✓ If Claude says it is using Metrillm or shows a Metrillm tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Metrillm yet

Metrillm runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Metrillm

Steps for Claude →Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
Steps for Claude Code →Install Node.js on your computer first (one time)
Steps for Cursor →Install Node.js on your computer first (one time)
Steps for VS Code →Install Node.js on your computer first (one time)

B · Others in Clinics & health that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Works with Claude Code, with some setup first

Install Node.js on your computer first (one time)

Let AI install it

Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Metrillm for Claude Code on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user metrillm -- npx -y metrillm-mcp 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Metrillm tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

1
Install Node.js (if you don’t have it)
Already installed? Check first · Open Terminal, type this command and press Enter
node -v
- A version number such as v26.13.1 = installed, skip this step
- "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
How to open Terminal
Mac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Done
Open Terminal
Mac: press Command+Space and type Terminal · Windows: open PowerShell
Done

Paste this command and press Enter

claude mcp add --scope user metrillm -- npx -y metrillm-mcp

Done

Type /mcp in Claude Code
You should see Metrillm listed as connected
Done
Try it
Use Metrillm and tell me what you can do for me, then show me one thing
✓ If Claude Code says it is using Metrillm or shows a Metrillm tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

Install Node.js on your computer first (one time)

Let AI install it

Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Metrillm for Cursor on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "metrillm": { "command": "npx", "args": [ "-y", "metrillm-mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Metrillm tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

1
Install Node.js (if you don’t have it)
Already installed? Check first · Open Terminal, type this command and press Enter
node -v
- A version number such as v26.13.1 = installed, skip this step
- "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
How to open Terminal
Mac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Done
Click this button to open Cursor
Open in Cursor
Cursor asks you to confirm; click Install
Done
Open the AI chat in Cursor in Agent mode
Done
Try it
Use Metrillm and tell me what you can do for me, then show me one thing
✓ If Cursor says it is using Metrillm or shows a Metrillm tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

Install Node.js on your computer first (one time)

Let AI install it

Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Metrillm for VS Code on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "metrillm": { "type": "stdio", "command": "npx", "args": [ "-y", "metrillm-mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Metrillm tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

1
Install Node.js (if you don’t have it)
Already installed? Check first · Open Terminal, type this command and press Enter
node -v
- A version number such as v26.13.1 = installed, skip this step
- "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
How to open Terminal
Mac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Done
Click this button to open VS Code
Open in VS Code
VS Code asks you to confirm; click Install
Done
Open the AI chat in VS Code in Agent mode
Done
Try it
Use Metrillm and tell me what you can do for me, then show me one thing
✓ If VS Code says it is using Metrillm or shows a Metrillm tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Metrillm💬 Discussion →

For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add --scope user metrillm -- npx -y metrillm-mcp

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "metrillm": {
      "command": "npx",
      "args": [
        "-y",
        "metrillm-mcp"
      ]
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "metrillm": {
      "command": "npx",
      "args": [
        "-y",
        "metrillm-mcp"
      ]
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "metrillm": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "metrillm-mcp"
      ]
    }
  }
}

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

GitHub stars i: 8 (Stars for the whole repo)
This repo holds several MCP listings; its stars count once in rankings
Downloads per weeki: 66/wk
Licence i: Apache-2.0
Connection: Runs on your computer
Transport: stdio
Latest versioni: 0.2.6
Categoryi: Clinics & health
Published to registryi: Mar 16, 2026
Code last changedi: Jun 2, 2026
Maker: MetriLLM
Packages: npm: metrillm-mcp
Repo: MetriLLM/metrillm
Registry status: Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

Claude Goose LM Studio Msty Studio Cherry Studio Cursor VS Code + GitHub Copilot Visual Studio Windsurf (Devin Desktop)Zed Kiro Cline Continue JetBrains AI Assistant Claude Code Codex CLI Gemini CLI OpenCode nodecode Warp LibreChat Raycast

All apps, with pros and cons →

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 15, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account MetriLLM, which owns the repo
✓ Pass
Still maintained
Code last changed 6 months ago
✓ Pass
Has a licence
Uses Apache-2.0
– Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
– Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
… Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints

Published vulnerabilities (OSV.dev)

Not checked yet

What we check → · JSON

Makers: ask for a re-check or report wrong info

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

User reviews

No reviews yet

Compared with others in Clinics & healthi

More stars than 88% of the other 1125 servers in this category
Published to the registry more recently than 2% of the other 1125 servers in this category
Basic checks equal to or better than 100% of the other 1125 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Metrillm safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed 6 months ago, and the latest version (0.2.6) reached the registry 8 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js on your computer.

What can I use instead?

In the same category: Medplum MCP, Mirobody, Codescene MCP Server, WHOOP — MissingMCP, Marrow

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Medplum MCP

Securely access and manage FHIR healthcare data stored in Medplum.

by medplumWidely used★ 2.8KUpdated 4 months ago

Runs in the cloud✓ service owner · medplum.com

How to connect

Mirobody

Lab results to LOINC codes and UCUM units, symptoms and diagnoses to ICPC-3. Offline, no API key.

by thetahealthGrowing↓ 725/wk★ 1.5KUpdated 5 days ago

Runs on your computer✓ thetahealth.ai

Install

Codescene MCP Server

An MCP server that provides CodeScene Code Health analysis tools.

by codescene-ossGrowing↓ 3.8K/wk★ 85Updated 8 months ago

Runs on your computer✓ service owner · codescene.com

Install

WHOOP — MissingMCP

WHOOP recovery, strain, sleep and workouts in Claude via official WHOOP OAuth. Free, open source.

by VelkyVenikEarly★ 21 Stars for the whole repoUpdated 4 months ago

Runs in the cloud✓ missingmcp.com

How to connect

Marrow

Marrow Health: your Apple Health data over MCP, from the free iOS app. Reads, and writes on demand.

by skeletonarmytechEarly↓ 62/wk★ 4Updated 24 days ago

Runs on your computer✓ skeletonarmy.tech

Install

Medplum MCP — Runs in the cloud, nothing to install · No key needed
Mirobody — Installs on your computer · No key needed
Codescene MCP Server — Installs on your computer · No key needed
WHOOP — MissingMCP — Runs in the cloud, nothing to install · No key needed
Marrow — Installs on your computer · No key needed

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

MetriLLM MCP Server

MCP (Model Context Protocol) server for MetriLLM — benchmark local LLMs directly from Claude Code, Cursor, Windsurf, Continue.dev, or any MCP-compatible client.

Quick Start

Claude Code

claude mcp add metrillm -- npx metrillm-mcp@latest

Claude Desktop

Add to claude_desktop_config.json:

"mcpServers": { "metrillm": { "command": "npx", "args": ["metrillm-mcp@latest"] } } }

Cursor / Windsurf / Continue.dev

Add to your editor's MCP configuration:

"mcpServers": { "metrillm": { "command": "npx", "args": ["metrillm-mcp@latest"] } } }

Prerequisites

Node.js >= 20
One local runtime available:
Ollama (ollama serve)
LM Studio (Local Server enabled)
At least one model available on the selected runtime

Available Tools

`list_models`

List all locally available LLM models.

Param	Type	Default	Description
`runtime`	`"ollama" \	"lm-studio"`	`"ollama"`	Inference runtime

Example response:

"models": [ { "name": "llama3.2:3b", "size": 2019393189, "parameterSize": "3.2B", "quantization": "Q4_K_M", "family": "llama" } ], "count": 1 }

`run_benchmark`

Run a full benchmark (performance + quality) on a local model.

Param	Type	Default	Description
`model`	`string`	(required)	Model name (e.g. `"llama3.2:3b"`)
`runtime`	`"ollama" \	"lm-studio"`	`"ollama"`	Inference runtime
`perfOnly`	`boolean`	`false`	If `true`, measure performance only (skip quality)

Example response:

"success": true, "model": "llama3.2:3b", "verdict": "GOOD", "globalScore": 65, "performance": { "tokensPerSecond": 42.5, "ttftMs": 120, "memoryUsedGB": 2.1, "memoryPercent": 13 }, "interpretation": "This model runs well on your hardware." }

`get_results`

Retrieve previous benchmark results stored locally.

Param	Type	Default	Description
`model`	`string`	(optional)	Filter by model name (substring match)
`runtime`	`"ollama" \	"lm-studio"`	`"ollama"`	Inference runtime

`share_result`

Upload a result to the public MetriLLM leaderboard.

Param	Type	Description
`resultFile`	`string`	Absolute path to the result JSON file

Uses official MetriLLM upload defaults out of the box.

Optional overrides for self-hosted/staging deployments:

METRILLM_SUPABASE_URL
METRILLM_SUPABASE_ANON_KEY
METRILLM_PUBLIC_RESULT_BASE_URL

Architecture

The MCP server is a thin wrapper around the existing MetriLLM CLI logic:

mcp/src/index.ts  → MCP entry point (stdio transport)

mcp/src/tools.ts → Tool definitions + calls to CLI modules ↓ ../src/core/ → CLI logic reused directly ../src/commands/ → CLI commands (bench, list)

No code duplication — the MCP server imports CLI modules directly.

Supported Runtimes

Runtime	Status
Ollama	Supported
LM Studio	Supported
MLX	Planned
llama.cpp	Planned
vLLM	Planned

The runtime parameter is present on every tool to prepare for multi-runtime support. Unimplemented runtimes return a clear error.

License

Apache License 2.0

Metrillm

What it does

Install

Install Node.js (if you don’t have it)

Open the Claude desktop app’s settings file

Paste these settings and save the file

Quit Claude and open it again

Try it

What you can do instead

Install Node.js (if you don’t have it)

Open Terminal

Paste this command and press Enter

Type /mcp in Claude Code

Try it

Install Node.js (if you don’t have it)

Click this button to open Cursor

Open the AI chat in Cursor in Agent mode

Try it

Install Node.js (if you don’t have it)

Click this button to open VS Code

Open the AI chat in VS Code in Agent mode

Try it

Installed on your computer

At a glance

Which apps can use it

Related guides

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Published vulnerabilities (OSV.dev)

Discussion

User reviews

Compared with others in Clinics & healthi

Common questions

Similar alternatives

Medplum MCP

Mirobody

Codescene MCP Server

WHOOP — MissingMCP

Marrow

README from the maker

MetriLLM MCP Server

Quick Start

Claude Code

Claude Desktop

Cursor / Windsurf / Continue.dev

Prerequisites

Available Tools

list_models

run_benchmark

get_results

share_result

Architecture

Supported Runtimes

License

`list_models`

`run_benchmark`

`get_results`

`share_result`