Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words

LLMBenchmark.ai

✓ service owner · llmbenchmark.ai

by Take-Groupversion 1.0.0i★ 0iRuns in the cloudOfficial site ↗
Registry nameai.llmbenchmark/llmbenchmark

How to install

What it does

Which LLM for which task: benchmark scores and API prices for 400+ models. Free, no key.

  • Connects Runs in the cloud
  • Account or key No key needed
  • Category Docs, sheets & office work

Use together with

Skills that teach the AI this kind of work; they work alongside this one

MinerU

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

by opendatalab★ 83,9721 skills

Skill · How-to guideNo license stated

watermarks-remover

A privacy-first app that strips AI watermarks from content you own.

by guillaumemeyer★ 27,7961 skills

Skill · How-to guide

obsidian-skills

Agent skills for Obsidian. Teach your agent to use Obsidian CLI and open formats including Markdown, Bases, JSON Canvas.

by kepano★ 53,183 (whole repo)5 skills

Skill · How-to guide

Why it ranks here

Lists are ordered by a usage score (out of 100) built from these parts

Popularity0/80GitHub stars or weekly downloads: the larger counts 60, the smaller 20
Freshness12/12Full marks for a release or code change within 30 days
Still answering8/8The cloud endpoint answered at the last check
Usage score20/100

Quality: Passed 4/4 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)

Install

Pick the AI app you use, then copy the settings.

Let your AI install it with one sentence

Please install LLMBenchmark.ai. Follow https://mcp.popnx.com/i/llmbenchmark.md, show me the commands and wait for my OK before running them.

Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads

Passed 4/4 checks · What you ask goes through the maker’s server (api.llmbenchmark.ai) · ✓ Commands checked Nov 20, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude · about 2 min

No key, nothing to install · Set it up once on claude.ai or the desktop app, then use it in chat · free accounts can add 1 · on Team/Enterprise an Owner adds it

  1. Open Claude’s Connectors page

    CustomizeConnectors

    CustomizeConnectors1Add2https://…3Add4
  2. Click “Add” → “Custom” → “Web” and fill in these 2 fields

    Copy each value into the field with the same name in Claude, then click Continue

    Name · NameLLMBenchmark.ai
    Remote MCP server URL · Addresshttps://api.llmbenchmark.ai/mcp

    Click Continue past the sign-in settings Claude detected · under Authentication choose what the maker says (Sign in now, Sign in when needed or No sign in), then click Add

  3. Turn it on in a chat

    +ConnectorsLLMBenchmark.ai

  4. Try it

    Use LLMBenchmark.ai and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using LLMBenchmark.ai or shows a LLMBenchmark.ai tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with ChatGPT, depending on your plan

Full MCP: ChatGPT Business, Enterprise or Edu on the web · Pro: connects with read/fetch permissions, so tools that change data may not work · Plus: not confirmed in OpenAI’s docs; if you see an add-custom-MCP option on the Plugins page you can try these steps · web only

  1. Open ChatGPT’s add-MCP page on the web

    Plugins+Add custom MCP server

    ChatGPTPlugins1+2https://…3Create4
  2. Fill in the name and address

    Enter a name, paste the address under Connection, tick the risk warning and click Create as a plugin

    Name · NameLLMBenchmark.ai
    Connection · Addresshttps://api.llmbenchmark.ai/mcp
  3. Pick LLMBenchmark.ai in a chat

    Start a new chat and pick LLMBenchmark.ai from your plugins before typing

  4. Try it

    Use LLMBenchmark.ai and tell me what you can do for me, then show me one thing

    ✓ If ChatGPT says it is using LLMBenchmark.ai or shows a LLMBenchmark.ai tool in the answer, you are connected

Menu names checked against OpenAI’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Claude Code · about 2 min

No key, nothing to install

  1. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  2. Paste this command and press Enter

    claude mcp add --transport http --scope user llmbenchmark https://api.llmbenchmark.ai/mcp
  3. Type /mcp in Claude Code

    You should see LLMBenchmark.ai listed as connected

  4. Try it

    Use LLMBenchmark.ai and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using LLMBenchmark.ai or shows a LLMBenchmark.ai tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor · about 2 min

No key, nothing to install

  1. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  2. Open the AI chat in Cursor in Agent mode

  3. Try it

    Use LLMBenchmark.ai and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using LLMBenchmark.ai or shows a LLMBenchmark.ai tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code · about 2 min

No key, nothing to install

  1. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  2. Open the AI chat in VS Code in Agent mode

  3. Try it

    Use LLMBenchmark.ai and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using LLMBenchmark.ai or shows a LLMBenchmark.ai tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

Address for apps that connect over the web

Addresshttps://api.llmbenchmark.ai/mcp

JSON settings are under “For developers” below

Stuck? Ask people who use LLMBenchmark.ai💬 Discussion →
For developers: Terminal commands and JSON settings

Over the web

Claude Code

claude mcp add --transport http --scope user llmbenchmark https://api.llmbenchmark.ai/mcp

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "llmbenchmark": {
      "url": "https://api.llmbenchmark.ai/mcp"
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "llmbenchmark": {
      "type": "http",
      "url": "https://api.llmbenchmark.ai/mcp"
    }
  }
}

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
Not on npm/PyPI
Verified domain
✓ llmbenchmark.ai
Connection
Runs in the cloud
Transport
streamable-http
Latest versioni
1.0.0
Published to registryi
Nov 20, 2026
Code last changedi
Nov 20, 2026
Last checked
Nov 20, 2026
Maker
Take-Group
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Connect over the internet in

ClaudeChatGPTGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatOpen WebUIRaycast

All apps, with pros and cons →

Related guides

What it can do

Tool names and descriptions exactly as the server reported them on Nov 20, 2026. The maker wrote them, not us; we show them as plain text.

  • recommend_model

    Which model should I use for this task? Maps the task text to a category (coding, agentic, reasoning, math, knowledge, web design, or overall when nothing matches) by a fixed keyword map, filters by output price per million tokens, context length and open weights, and ranks by th

  • get_leaderboard

    The top models on one category's board. category is one of overall, coding, agentic, reasoning, math, knowledge, design (see list_categories). limit is 1 to 50. overall is the LLMBenchmark Index: a weighted mean of the Vibe Coding Index, the agentic, reasoning, math and knowledge

  • compare_models

    Two models side by side: score on every category board where both were measured, prices, context. Names are matched loosely: 'claude opus', 'gpt-5' or a slug all work.

  • get_model

    One model: maker, release date, prices, context, open weights, and its score and rank on every category board. Name or slug.

  • get_prices

    API prices (USD per million tokens), cheapest output price first: the maker's own price when it serves the model on OpenRouter, else the median of providers (price_basis says which), plus the cheapest provider. Filter by model name and/or maker; limit is 1 to 100.

  • list_categories

    The categories recommend_model and get_leaderboard know, the benchmark board behind each, and the task keywords that select it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 20, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified against the domain llmbenchmark.ai (the registry checks domain ownership)

  • ✓ Pass

    Still maintained

    Code last changed today

  • – Not applicable

    Has a licence

    Not applicable: a cloud server run by the owner of llmbenchmark.ai; you don't run code from the repo

  • ✓ Pass

    Endpoint responds

    Responded in 459 ms (HTTP 200)

  • – Not applicable

    Sign-in with OAuth

    No sign-in needed

  • ✓ Pass

    No hidden instructions in tool descriptions

    Read 6 tool descriptions and found no hidden instructions to the AI

What we check → · JSON

Makers: ask for a re-check or report wrong info
For makers: add a badge to your README

If you made this, paste this code into your README. The badge links back to this page.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/llmbenchmark.svg)](https://mcp.popnx.com/en/servers/llmbenchmark)

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Docs, sheets & office worki

  • More stars than 0% of the other 4155 servers in this category
  • Published to the registry more recently than 99% of the other 4155 servers in this category
  • Basic checks equal to or better than 99% of the other 4155 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is LLMBenchmark.ai safe?

It passed 4 of 4 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.

Is it still maintained?

The GitHub repo last changed today, and the latest version (1.0.0) reached the registry today.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT on the web (full MCP on Business and above; Pro read-only).

What can I use instead?

In the same category: Puter MCP, XcodeBuildMCP, Vexa, Atlassian Rovo MCP Server, Anki MCP Server

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Puter MCP

Puter MCP enables AI tools to interact with Puter: manage files, websites, workers, and more

by HeyPuterWidely used★ 44.2KUpdated 5 months ago

Runs in the cloud✓ service owner · puter.com

XcodeBuildMCP

XcodeBuildMCP provides tools for Xcode project management, simulator management, and app utilities.

by getsentryWidely used↓ 130.5K/wk shared package★ 6.6KUpdated 4 months ago

Runs on your computer✓ service owner · xcodebuildmcp.com

Vexa

Meeting bot and transcripts for Google Meet, Teams and Zoom. Live or after, speakers labelled.

by Vexa-aiWidely used★ 3KUpdated 2 months ago

Runs in the cloud✓ service owner · vexa.ai

Atlassian Rovo MCP Server

Atlassian’s official server lets AI search and manage Jira work and Confluence pages. Connects to Atlassian’s cloud with OAuth sign-in.

by atlassianGrowing★ 1.2KUpdated 2 months ago

Runs in the cloud✓ service owner · atlassian.com

Anki MCP Server

MCP server for Anki flashcards: adaptive review, notes, media, and deck management via AnkiConnect.

by ankimcpGrowing↓ 1.1K/wk★ 568Updated 2 months ago

Runs on your computer✓ service owner · ankimcp.ai
Compared with similar ones
This one
LLMBenchmark.ai
Puter MCPXcodeBuildMCPVexaAtlassian Rovo MCP ServerAnki MCP Server
Runs whereRuns in the cloud, nothing to installRuns in the cloud, nothing to installInstalls on your computerRuns in the cloud, nothing to installRuns in the cloud, nothing to installInstalls on your computer
Needs a keyNoNoNoYesNoNo
Add with + in ClaudeNoNoNoNoYesNo
Basic checks4/44/43/32/44/43/3
LicenseMITAGPL-3.0MITApache-2.0Apache-2.0MIT
PriceNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registry

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

LLMBenchmark.ai MCP server

Ask "which model should I use for this task?" and get an answer from benchmark scores and API prices of 400+ LLMs, updated daily.

  • Free. No API key. 500 requests per IP per UTC day.
  • Remote server, Streamable HTTP: https://api.llmbenchmark.ai/mcp
  • Deterministic: no LLM call inside, the same task and the same data return the same answer.
  • Every answer carries the data date, the source ("LLMBenchmark.ai") and links to the pages behind the numbers.

Docs: https://llmbenchmark.ai/api

Install

Claude Code

claude mcp add --transport http llmbenchmark https://api.llmbenchmark.ai/mcp

Cursor (.cursor/mcp.json)

{

"mcpServers": { "llmbenchmark": { "url": "https://api.llmbenchmark.ai/mcp" } } }

Codex (~/.codex/config.toml)

[mcp_servers.llmbenchmark]

url = "https://api.llmbenchmark.ai/mcp"

Claude Desktop (claude_desktop_config.json, through the mcp-remote bridge)

{

"mcpServers": { "llmbenchmark": { "command": "npx", "args": ["-y", "mcp-remote", "https://api.llmbenchmark.ai/mcp"] } } }

Install as a local server (stdio)

The package proxies to the hosted server, so clients that only start local commands can use it too. Needs uv.

uvx llmbenchmark-mcp

Claude Desktop (claude_desktop_config.json):

{

"mcpServers": { "llmbenchmark": { "command": "uvx", "args": ["llmbenchmark-mcp"] } } }

Docker, built from this repository:

docker build -t llmbenchmark-mcp . && docker run -i --rm llmbenchmark-mcp

Set LLMBENCHMARK_MCP_URL to point the proxy at another endpoint.

Tools

ToolWhat it does
recommend_modelTask text plus optional limits (max_output_price_per_m, min_context_tokens, open_weights_only, top_k) in, ranked models with scores, prices and a one-line reason out.
get_leaderboardTop models on one board: overall, coding, agentic, reasoning, math, knowledge, design.
compare_modelsTwo models side by side on every board where both were measured.
get_modelOne model: maker, prices, context, open weights, score and rank per board.
get_pricesAPI list prices per million tokens, cheapest first, by model or maker.
list_categoriesThe categories, the board behind each and the task keywords that select it.

recommend_model maps the task to a category with a fixed keyword map (printed at https://llmbenchmark.ai/api#how-recommend-works), drops models that break your limits and ranks the rest on that category's board. If nothing fits your limits it says so and returns the nearest options.

Example prompts

  • "Which model should I use to refactor a React app under $5 per million output tokens?"
  • "What is the best open-weight model for math with at least a 128k context window?"
  • "Compare Claude Opus and GPT-6 Astra for coding."
  • "Which models are cheapest on output price from DeepSeek?"

CLI

llmbenchmark-mcp recommend "refactor a React app" --max-price 5 --open-weights

llmbenchmark-mcp tools llmbenchmark-mcp config

recommend prints the recommend_model answer, tools lists the tool names, config prints the remote JSON config for Claude or Cursor. With no arguments the command runs the stdio server.

REST

The same answers over plain HTTP:

curl "https://api.llmbenchmark.ai/v1/recommend?task=refactor+a+large+React+codebase&max_output_price_per_m=5"

License

  • This README and the configuration files in this repository: MIT, see LICENSE.
  • The data the server returns: CC BY 4.0. Credit "LLMBenchmark.ai" with a link to https://llmbenchmark.ai. Each score names its source board and the day it was read; the boards keep their own terms.

Run by Take Group.