Codabench MCP

Name: Codabench MCP
Author: harshitAgr

by harshitAgrversion 0.1.1i★ 0iRuns on your computer

Registry nameio.github.harshitAgr/codabench-mcp

How to install

Overview

Description from the maker (original English)

MCP server for the Codabench REST API — drives a full ML-benchmark participant workflow.

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs on your computer
Transport: stdio
Category: Other
You need to fill in: CODABENCH_API_TOKEN

Install

Pick the AI app you use, then copy the settings.

Passed 3/3 checks · Runs on your computer

First: which AI do you use?

ClaudeWeb · app · phoneChatGPTWebClaude CodeTerminalCursorCode editorVS CodeCode editorOtherOther apps

Pick your app and the steps appear below.

Works with Claude, with some setup first

You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Install Python (uv)
One time only; it works for every server that needs Python (uv)
Open the Python (uv) download page ↗
Done
Sign up and create a Codabench MCP key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Done
Open the Claude desktop app’s settings file
SettingsDeveloperEdit Config
Done

Paste these settings and save the file

{
  "mcpServers": {
    "codabench": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "your-value"
      }
    }
  }
}

Paste the key only into the app’s field, never into a chat or to anyone

Done

Quit Claude and open it again
Done
Try it
Use Codabench MCP and tell me what you can do for me, then show me one thing
✓ If Claude says it is using Codabench MCP or shows a Codabench MCP tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Codabench MCP yet

Codabench MCP runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Codabench MCP

Steps for Claude →You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
Steps for Claude Code →You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time)
Steps for Cursor →You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time)
Steps for VS Code →You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time)

B · Others in Other that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Hostinger✓ ChatGPT
World Monitor✓ ChatGPT
Svelte MCP✓ ChatGPT

Works with Claude Code, with some setup first

You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time)

Install Python (uv)
One time only; it works for every server that needs Python (uv)
Open the Python (uv) download page ↗
Done
Sign up and create a Codabench MCP key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Done
Open Terminal
Mac: press Command+Space and type Terminal · Windows: open PowerShell
Done
4
Paste this command and press Enter
```
claude mcp add codabench --env CODABENCH_API_TOKEN=your-value -- uvx codabench-mcp
```
Replace “your-value” with your key before pressing Enter
Paste the key only into the app’s field, never into a chat or to anyone
Done
Type /mcp in Claude Code
You should see Codabench MCP listed as connected
Done
Try it
Use Codabench MCP and tell me what you can do for me, then show me one thing
✓ If Claude Code says it is using Codabench MCP or shows a Codabench MCP tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time)

Install Python (uv)
One time only; it works for every server that needs Python (uv)
Open the Python (uv) download page ↗
Done
Sign up and create a Codabench MCP key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Done
Click this button to open Cursor
Open in Cursor
Cursor asks you to confirm; click Install
Done
Fill in your key
In the Codabench MCP settings, CODABENCH_API_TOKEN is empty; add your key and save
Paste the key only into the app’s field, never into a chat or to anyone
Done
Open the AI chat in Cursor in Agent mode
Done
Try it
Use Codabench MCP and tell me what you can do for me, then show me one thing
✓ If Cursor says it is using Codabench MCP or shows a Codabench MCP tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

You need a Codabench MCP key (sign up on the maker’s site, may cost money) · Install Python (uv) on your computer first (one time)

Install Python (uv)
One time only; it works for every server that needs Python (uv)
Open the Python (uv) download page ↗
Done
Sign up and create a Codabench MCP key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Done
Click this button to open VS Code
Open in VS Code
VS Code asks you to confirm; click Install
Done
Fill in your key
In the Codabench MCP settings, CODABENCH_API_TOKEN is empty; add your key and save
Paste the key only into the app’s field, never into a chat or to anyone
Done
Open the AI chat in VS Code in Agent mode
Done
Try it
Use Codabench MCP and tell me what you can do for me, then show me one thing
✓ If VS Code says it is using Codabench MCP or shows a Codabench MCP tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Codabench MCP💬 Discussion →

For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add codabench --env CODABENCH_API_TOKEN=your-value -- uvx codabench-mcp

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "codabench": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "your-value"
      }
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "codabench": {
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "your-value"
      }
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "codabench": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "codabench-mcp"
      ],
      "env": {
        "CODABENCH_API_TOKEN": "your-value"
      }
    }
  }
}

Values you fill in

CODABENCH_API_TOKEN secret required env
DRF token for Codabench. Obtain via https://www.codabench.org/api/docs/ > api-token-auth > Try it out.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

GitHub stars i: 0
Downloads per weeki: 20/wk
Licence i: MIT
Connection: Runs on your computer
Transport: stdio
Latest versioni: 0.1.1
Categoryi: Other
Published to registryi: Apr 23, 2026
Code last changedi: Nov 5, 2026
Maker: harshitAgr
Packages: pypi: codabench-mcp
Repo: harshitAgr/codabench-mcp
Registry status: Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

Claude Goose LM Studio Msty Studio Cherry Studio Cursor VS Code + GitHub Copilot Visual Studio Windsurf (Devin Desktop)Zed Kiro Cline Continue JetBrains AI Assistant Claude Code Codex CLI Gemini CLI OpenCode nodecode Warp LibreChat Raycast

All apps, with pros and cons →

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 12, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account harshitAgr, which owns the repo
✓ Pass
Still maintained
Code last changed 7 days ago
✓ Pass
Has a licence
Uses MIT
– Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
– Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
… Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

User reviews

No reviews yet

Compared with others in Otheri

More stars than 0% of the other 19286 servers in this category
Published to the registry more recently than 6% of the other 19286 servers in this category
Basic checks equal to or better than 100% of the other 19286 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Codabench MCP safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: CODABENCH_API_TOKEN

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed 7 days ago, and the latest version (0.1.1) reached the registry 7 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Python (uv) on your computer.

What can I use instead?

In the same category: World Monitor, Claude Flow, Tldraw

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

World Monitor

Real-time global intelligence on conflict, markets, energy, trade, shipping and cyber. 102 tools.

by koala73Widely used★ 90.5KUpdated today

Runs in the cloud✓ worldmonitor.app

Install

Claude Flow

AI orchestration with hive-mind swarms, neural networks, and 87 MCP tools for enterprise dev.

by ruvnetWidely used↓ 13.5K/wk★ 81.5KUpdated 14 months ago

Runs on your computer

Install

Tldraw

Draw and visually collaborate with your agents on tldraw's canvas.

by tldrawWidely used★ 51.4KUpdated 8 months ago

Runs in the cloud

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

codabench-mcp

MCP server for the Codabench REST API. Lets an AI agent drive a full participant ML-benchmark workflow: discover competitions, read rules, download data, submit, poll, read leaderboards.

Features

Curated tools for the participant path:

search_competitions, get_competition, list_competition_phases, get_phase, get_competition_rules, list_competition_tasks, get_task
download_dataset (streaming + SHA-256)
list_my_submissions, get_submission, get_submission_logs
submit_to_phase (handles Codabench's 3-step upload flow)
poll_submission (backoff + timeout + non-error "still_running")
get_leaderboard, get_my_profile
codabench_request — generic REST escape hatch (GET-only by default)

Authentication

You need a Codabench API token. Two ways to get one:

1. Swagger UI (recommended)

Visit https://www.codabench.org/api/docs/
Find the api-token-auth endpoint → Try it out
POST your username/password
Copy the token value from the response

2. curl

curl -X POST https://www.codabench.org/api/api-token-auth/ \

-H "Content-Type: application/json" \ -d '{"username":"YOUR_USERNAME","password":"YOUR_PASSWORD"}'

The response is {"token": "..."}.

Install

uvx codabench-mcp

To run the bleeding-edge main branch instead of the last release:

uvx --from git+https://github.com/harshitAgr/codabench-mcp codabench-mcp

Or for development:

git clone https://github.com/harshitAgr/codabench-mcp.git

cd codabench-mcp uv sync uv run codabench-mcp # requires CODABENCH_API_TOKEN

Configure an MCP client

Claude Desktop (`claude_desktop_config.json`)

"mcpServers": { "codabench": { "command": "uvx", "args": ["codabench-mcp"], "env": { "CODABENCH_API_TOKEN": "paste-your-token-here" } } } }

Claude Code (plugin marketplace)

/plugin marketplace add harshitAgr/codabench-mcp

/plugin install codabench-mcp@codabench-mcp

Then export your token in the shell where you launch Claude Code:

export CODABENCH_API_TOKEN=paste-your-token-here

Claude Code (manual)

If you'd rather skip the plugin layer:

claude mcp add codabench \

--env CODABENCH_API_TOKEN=paste-your-token-here \ -- uvx codabench-mcp

Environment variables

Variable	Required	Default	Purpose
`CODABENCH_API_TOKEN`	yes	—	DRF token, sent as `Authorization: Token`
`CODABENCH_BASE_URL`	no	`https://www.codabench.org`	Override for tests
`CODABENCH_ALLOW_WRITE_RAW`	no	`0`	Set to `1` to allow non-GET methods through `codabench_request`
`CODABENCH_MAX_DOWNLOAD_BYTES`	no	`5368709120` (5 GB)	Cap for `download_dataset`

Development

uv sync

uv run pytest # unit tests, no network uv run ruff check . # lint uv run ruff format --check . # format check

License

MIT — see LICENSE.

mcp-name: io.github.harshitAgr/codabench-mcp

Codabench MCP

Overview

What you can do with it

Install

Install Python (uv)

Sign up and create a Codabench MCP key

Open the Claude desktop app’s settings file

Paste these settings and save the file

Quit Claude and open it again

Try it

What you can do instead

Install Python (uv)

Sign up and create a Codabench MCP key

Open Terminal

Paste this command and press Enter

Type /mcp in Claude Code

Try it

Install Python (uv)

Sign up and create a Codabench MCP key

Click this button to open Cursor

Fill in your key

Open the AI chat in Cursor in Agent mode

Try it

Install Python (uv)

Sign up and create a Codabench MCP key

Click this button to open VS Code

Fill in your key

Open the AI chat in VS Code in Agent mode

Try it

Installed on your computer

Values you fill in

At a glance

Which apps can use it

Related guides

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Discussion

User reviews

Compared with others in Otheri

Common questions

Alternatives

World Monitor

Claude Flow

Tldraw

README from the maker

codabench-mcp

Features

Authentication

1. Swagger UI (recommended)

2. curl

Install

Configure an MCP client

Claude Desktop (claude_desktop_config.json)

Claude Code (plugin marketplace)

Claude Code (manual)

Environment variables

Development

License

Claude Desktop (`claude_desktop_config.json`)