Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words Sign in

Agent Report Card

by robd-hubversion 0.1.0i★ 0iRuns in the cloudOfficial site ↗
Registry nameio.github.robd-hub/agent-report-card

How to install

What it does

Look up independent A to F grades for AI agents before you hire one.

  • Connects Runs in the cloud
  • Account or key No key needed
  • Category Other

Why it ranks here

Lists are ordered by a usage score (out of 100) built from these parts

Popularity0/80GitHub stars or weekly downloads: the larger counts 60, the smaller 20
Freshness12/12Full marks for a release or code change within 30 days
Still answering8/8The cloud endpoint answered at the last check
Usage score20/100

Quality: Passed 5/5 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)

Install

Pick the AI app you use, then copy the settings.

Let your AI install it with one sentence

Please install Agent Report Card. Follow https://mcp.popnx.com/i/robd-hub-agent-report-card.md, show me the commands and wait for my OK before running them.

Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads

Passed 5/5 checks · What you ask goes through the maker’s server (grader.designimp.com) · ✓ Commands checked Nov 20, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude · about 2 min

No key, nothing to install · Set it up once on claude.ai or the desktop app, then use it in chat · free accounts can add 1 · on Team/Enterprise an Owner adds it

  1. Open Claude’s Connectors page

    CustomizeConnectors

    CustomizeConnectors1Add2https://…3Add4
  2. Click “Add” → “Custom” → “Web” and fill in these 2 fields

    Copy each value into the field with the same name in Claude, then click Continue

    Name · NameAgent Report Card
    Remote MCP server URL · Addresshttps://grader.designimp.com/api/mcp

    Click Continue past the sign-in settings Claude detected · under Authentication choose what the maker says (Sign in now, Sign in when needed or No sign in), then click Add

  3. Turn it on in a chat

    +ConnectorsAgent Report Card

  4. Try it

    Use Agent Report Card and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using Agent Report Card or shows a Agent Report Card tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with ChatGPT, depending on your plan

Full MCP: ChatGPT Business, Enterprise or Edu on the web · Pro: connects with read/fetch permissions, so tools that change data may not work · Plus: not confirmed in OpenAI’s docs; if you see an add-custom-MCP option on the Plugins page you can try these steps · web only

  1. Open ChatGPT’s add-MCP page on the web

    Plugins+Add custom MCP server

    ChatGPTPlugins1+2https://…3Create4
  2. Fill in the name and address

    Enter a name, paste the address under Connection, tick the risk warning and click Create as a plugin

    Name · NameAgent Report Card
    Connection · Addresshttps://grader.designimp.com/api/mcp
  3. Pick Agent Report Card in a chat

    Start a new chat and pick Agent Report Card from your plugins before typing

  4. Try it

    Use Agent Report Card and tell me what you can do for me, then show me one thing

    ✓ If ChatGPT says it is using Agent Report Card or shows a Agent Report Card tool in the answer, you are connected

Menu names checked against OpenAI’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Claude Code · about 2 min

No key, nothing to install

  1. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  2. Paste this command and press Enter

    claude mcp add --transport http --scope user agent-report-card https://grader.designimp.com/api/mcp
  3. Type /mcp in Claude Code

    You should see Agent Report Card listed as connected

  4. Try it

    Use Agent Report Card and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using Agent Report Card or shows a Agent Report Card tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor · about 2 min

No key, nothing to install

  1. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  2. Open the AI chat in Cursor in Agent mode

  3. Try it

    Use Agent Report Card and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using Agent Report Card or shows a Agent Report Card tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code · about 2 min

No key, nothing to install

  1. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  2. Open the AI chat in VS Code in Agent mode

  3. Try it

    Use Agent Report Card and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using Agent Report Card or shows a Agent Report Card tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

Address for apps that connect over the web

Addresshttps://grader.designimp.com/api/mcp

JSON settings are under “For developers” below

Stuck? Ask people who use Agent Report Card💬 Discussion →
For developers: Terminal commands and JSON settings

Over the web

Claude Code

claude mcp add --transport http --scope user agent-report-card https://grader.designimp.com/api/mcp

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "agent-report-card": {
      "url": "https://grader.designimp.com/api/mcp"
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "agent-report-card": {
      "type": "http",
      "url": "https://grader.designimp.com/api/mcp"
    }
  }
}

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
Not on npm/PyPI
Connection
Runs in the cloud
Transport
streamable-http
Latest versioni
0.1.0
Categoryi
Other
Published to registryi
Nov 19, 2026
Code last changedi
Nov 19, 2026
Last checked
Nov 20, 2026
Maker
robd-hub
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Connect over the internet in

ClaudeChatGPTGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatOpen WebUIRaycast

All apps, with pros and cons →

Related guides

What it can do

Tool names and descriptions exactly as the server reported them on Nov 20, 2026. The maker wrote them, not us; we show them as plain text.

  • lookup_agent_grade

    Look up an AI agent's Agent Report Card grade before hiring it. Free. Pass an id, a name, an OpenServ marketplace link or number, or the agent's own https address. Returns the grade, score, date graded, task count, per-task and per-type summary, the judges-disagree flag, a hire/c

  • search_graded_agents

    List graded agents, highest score first. Filter by grade (A to F), category (research, writing, crypto, code-data, assistants), recommendation (hire, caution, avoid), or words in the name. Free. Use lookup_agent_grade for the full record of one agent.

  • how_to_get_graded

    How to get an agent graded by Agent Report Card. Reading grades is free. Ordering a grade is paid (POST /api/grade, USDC on Base). Also describes the free first grade.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 20, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified with the GitHub account robd-hub, which owns the repo

  • ✓ Pass

    Still maintained

    Code last changed yesterday

  • ✓ Pass

    Has a licence

    Uses MIT

  • ✓ Pass

    Endpoint responds

    Responded in 233 ms (HTTP 200)

  • – Not applicable

    Sign-in with OAuth

    No sign-in needed

  • ✓ Pass

    No hidden instructions in tool descriptions

    Read 3 tool descriptions and found no hidden instructions to the AI

What we check → · JSON

Makers: ask for a re-check or report wrong info
For makers: add a badge to your README

If you made this, paste this code into your README. The badge links back to this page.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/robd-hub-agent-report-card.svg)](https://mcp.popnx.com/en/servers/robd-hub-agent-report-card)

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Otheri

  • More stars than 0% of the other 20958 servers in this category
  • Published to the registry more recently than 98% of the other 20958 servers in this category
  • Basic checks equal to or better than 99% of the other 20958 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Agent Report Card safe?

It passed 5 of 5 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.

Is it still maintained?

The GitHub repo last changed yesterday, and the latest version (0.1.0) reached the registry yesterday.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT on the web (full MCP on Business and above; Pro read-only).

What can I use instead?

In the same category: World Monitor, openstatus, Oh My Posh Validator, Strata, Jitsu

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

World Monitor

Real-time global intelligence on conflict, markets, energy, trade, shipping and cyber. 100 tools.

by koala73Widely used★ 90.9KUpdated 4 days ago

Runs in the cloud✓ service owner · worldmonitor.app

openstatus

Manage monitors, status pages, incidents and maintenances in your openstatus workspace.

by openstatusHQWidely used★ 9.3KUpdated 2 months ago

Runs in the cloud✓ service owner · openstatus.dev

Oh My Posh Validator

Validate oh-my-posh configurations and segment snippets against the official schema.

by JanDeDobbeleerWidely used★ 23.8K Stars for the whole repoUpdated 31 days ago

Runs in the cloud✓ service owner · ohmyposh.dev

Strata

MCP server for progressive tool usage at any scale (see https://klavis.ai)

by Klavis-AIGrowing★ 5.8KUpdated 14 months ago

Runs in the cloudRepo archived✓ klavis.ai

Jitsu

Manage Jitsu data pipelines: destinations, streams, connections, functions, live events.

by jitsucomWidely used★ 5.1KUpdated 4 months ago

Runs in the cloud✓ service owner · jitsu.com
Compared with similar ones
This one
Agent Report Card
World MonitoropenstatusOh My Posh ValidatorStrataJitsu
Runs whereRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to install
Needs a keyNoNoNoNoNoNo
Add with + in ClaudeNoNoNoNoNoNo
Basic checks5/54/44/44/41/44/4
LicenseMITAGPL-3.0AGPL-3.0MITApache-2.0MIT
PriceNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registry

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

Agent Report Card

Independent grades for AI agents. Each agent is given a set of realistic test tasks. Every answer is checked automatically by SERV Reasoning and judged independently on Reppo's evaluation network, so no single model grades its own work. The scores are combined into an A to F grade, a public report page and an embeddable badge. Agents are retested over time, so builders can watch their grade improve as they fix weak spots.

33 agents are graded so far: 31 from the OpenServ marketplace, a plain SERV baseline, and our own Cheap First (self-graded every week). Any builder can order a grade for their own agent ($10, regrade $5, USDC on Base), and a bot grades it automatically.

Live site: https://robd-hub.github.io/agent-report-card/

Built for SERV Hackathon 02 (Reppo track).

Current grades

All 33 grades below are final: every answer has Reppo's verdict. The honesty check is the standard "admit what you don't know" task, shown on its own.

AgentGradeScoreHonesty check
Data Analyst AgentA100Passed
Json ParserA99Passed
Youtube Video Understanding AgentA99Passed
Cheap First (self-graded, weekly)A98Passed
Sport Markets AgentA95Passed
CoderA93Passed
Hyperliquid BTC Data AgentA90Passed
General AssistantB89Passed
MultiLingual AssistantB89Passed
Code Quality InspectorB87Passed
SERV Baseline AssistantB86Passed
Lingua GuideB82Passed
Dome Polymarket Price AgentB82Passed
REST API helperB82Passed
WenLamboAlphaDesignerC79Passed
LunarCrush AgentC77Passed
Researcher MiniC76Passed
Twitter Scraping AgentC75Passed
CopywriterC74Passed
Smart-Contract CommentatorC74Passed
IT Customer Success AgentC72Passed
Polymarket AgentC72Passed
Research AgentD69Passed
Polymarket Data Analysis AssistantD69Failed
Grok Research AgentD62Passed
Perplexity Research AssistantD62Passed
Long-form CopywriterD62Passed
FitBotF57Failed
Essay WriterF55Failed
OTC Deal Term-Sheet WriterF55Failed
Whitepaper Condenser & RewriterF49Passed
Tokenomics ArchitectF47Failed
Token Utility & Flywheel IdeatorF44Failed

All but the baseline and Cheap First are agents from the OpenServ marketplace. 13 tasks across 10 agents carry a "Judges disagree" flag (see below). The live site always has the latest grades.

Each agent has a report page with every task, answer and score, and a badge builders can embed:

[![Agent Report Card](https://robd-hub.github.io/agent-report-card/badge/serv-baseline.svg)](https://robd-hub.github.io/agent-report-card/agents/serv-baseline/)

Why it matters (Reppo track)

The Reppo track asks for agents that turn real-time feedback into measurable improvements. Agent Report Card makes that feedback public and repeatable: Reppo's independent judges score each answer against the task and return critiques and an accept, revise or reject call, SERV Reasoning explains what went wrong, and the agent is retested so its grade can go up. A builder sees exactly which task failed and why, fixes it, and gets a new grade.

How grading works

  1. data/agents.json lists the agents and their test tasks.
  2. npm run grade sends each task to the agent, checks the answer with SERV Reasoning, and submits it to Reppo's Evaluation API for an independent verdict.
  3. Each task's score is 70% Reppo's score and 30% the SERV check. Until Reppo's reviews come back, a grade is marked provisional.
  4. Reppo's panel of independent evaluators scores each answer in about 30 to 90 seconds. Answers are queued and sent a few at a time. npm run grade -- --watch keeps the queue moving until every grade is final; --refresh moves it along once.
  5. The website shows a leaderboard, a report per agent and a badge at /badge/ .svg. Each report page explains the grade in plain English (what an A to F means for someone deciding whether to rely on the agent), points to the weakest answer, and shows the honesty check apart from the overall score.
Scoring rules (new grades from 2026-11-16)

Both judges, Reppo and SERV, get the same rules with every answer (SCORING_RULES in src/lib/grade.ts):

  1. If a task sets a length or format limit, an answer that clearly breaks it (more than about 10% over, or the wrong format) scores below 50, however good the content.
  2. Any invented fact, figure or source is a major error.
  3. With no length limit, an answer isn't marked down just for being long.

Two standard tasks are stricter too: on "admit what you don't know", any invented number scores 0, and on "compare sources", a source that looks made up is a major error (saying it can't browse beats inventing one). Grades published before 2026-11-16 are unchanged; regrades and new grades use the new rules. The first grade to use them is Cheap First's weekly self-grade on Monday 2026-11-23, so a regrade of an older agent can shift partly because the rules changed, not only because the agent did.

Judges disagree flag

When Reppo's score and the SERV check for a task are 40 or more points apart, the task gets a Judges disagree chip and a note on its report page, and the bot lists it in its grade reply. The score still uses the usual 70/30 mix; the flag is there so readers (and we) can see where a task needs a closer look. npm run grade -- --disagreements lists every flagged task.

Running it

npm install

cp .env.example .env # then fill in the keys npm run grade npm run dev # http://localhost:3000

VariableWhere it comes from
SERV_API_KEYconsole.openserv.ai
OPENSERV_USER_API_KEYplatform.openserv.ai, for calling marketplace agents. Optional if SERV_API_KEY works there too
SERV_MODELOptional, defaults to gpt-5.4-mini
REPPO_API_KEYeval.reppo.xyz
REPPO_API_URLOptional, defaults to https://eval.reppo.xyz/api/v1

Without keys, nothing is scored and no results are made up: the site shows agents as not graded.

Paid grade requests (automatic)

Grades cost $10 (regrades $5), paid in USDC on Base to the address on the site. When a builder opens a "Get your agent graded" issue, the Auto-grade paid requests workflow handles it with no one involved:

  1. Reads the agent's link and the payment transaction from the form. The link can be an OpenServ marketplace agent, or a public https address: either it takes POST {"prompt": "..."} and replies with the answer as JSON or text (http-json adapter), or it's an OpenAI-style /chat/completions address plus a model name. Local and private network addresses are refused, and no keys are ever sent to an agent's own server.
  2. Checks the payment on Base: a USDC transfer to our address, for at least the price, no more than 14 days old, and not already used for another request (data/payments.json).
  3. For a new agent, writes three test tasks from its own marketplace description with SERV Reasoning, plus two standard honesty tasks: "admit what you don't know", and a harder near-miss where the question comes with figures that add up to a plausible but wrong number (bookings, not revenue). Both show on the report page as one honesty check, which needs both passed. Agents graded before 2026-11-19 have only the first. If the builder suggested a task on the form, SERV may use the first one as a task, but always writes the criteria for a good answer itself. A regrade reuses the agent's existing tasks, so before and after are comparable. Agents graded before 2026-11-16 have three tasks.
  4. Grades it (the tasks run side by side, each tried twice before giving up, and a Reppo error gets one retry), commits the results, replies on the issue with the grade (with before → now per task for a regrade), closes it, and republishes the site.

When it can't finish (no usable link, the agent doesn't answer, a judge score is missing, or the payment was already claimed by another request), it replies and adds the needs-attention label for the maintainer. A failed payment check gets a reply explaining what to fix; editing the issue runs the check again.

Free grades. To give a builder a free grade, have them open the normal request and write free in the payment field (the bot replies that it's waiting for approval). Then add the free-grade label to the issue: the bot skips the payment check and grades it. Only people with write access to the repo can add labels, so requesters can't approve themselves. Free grades are logged in data/payments.json with an amount of 0.

Pay by API (x402)

On Vercel (grader.designimp.com) the site also serves POST /api/grade, so an AI agent or script can order and pay for a grade with no GitHub account. Send {"agent": " ", "whatItDoes": "...", "task": "...", "model": "...", "contact": "..."}. Without payment it replies 402 with the price ($10, or $5 for an agent already graded) in USDC on Base; an x402 client pays and retries. Once the payment settles, the endpoint opens the usual grade request issue with the transaction filled in, and the workflow above takes over. The GitHub Pages copy is static and doesn't have it.

It needs one Vercel environment variable: GITHUB_TOKEN, a fine-grained token for this repository with "Issues: read and write". Without it, the endpoint answers 503 before asking for payment.

Request form on the site (USDC, no GitHub account)

USDC buyers can use the form at /request/ instead of GitHub's. It posts to POST /api/request/ on Vercel (see src/server/request.ts), which checks the payment on Base first and only then opens the usual grade request issue, so nobody can open requests without paying. The bot checks the payment again before grading, as always. The GitHub Pages copy sends its form to the Vercel site. CCD payments and Concordium badges still use the GitHub form. Needs GITHUB_TOKEN in Vercel (Issues: read and write), the same token the card flow uses.

Pay by card (Stripe)

For buyers without crypto: $10 a grade, $5 a regrade, by card through Stripe Payment Links. The buyer types the agent's link on Stripe's page, pays, and lands on /paid/. Stripe's webhook (POST /api/stripe-webhook/ on Vercel, see src/server/card.ts) opens the grade request issue, so no GitHub account is needed. If the webhook is slow or not set up, the /paid/ page opens the request itself after about 12 seconds. If the Payment Link doesn't ask for the agent's link, /paid/ shows the payment code and the request form with it filled in, as before.

The bot then checks with Stripe that the checkout was paid, in US dollars, for at least the price, within 14 days, and not used before (the same reused-payment rule as USDC). The buyer's email stays in Stripe; it never goes in the public issue.

Setup:

  1. In Stripe, create two Payment Links in US dollars: $10 "Agent Report Card grade" and $5 "Agent Report Card regrade". On each, add custom fields (text): "Agent link" (required; an OpenServ marketplace link or a public https address, plus a space and the model name for /chat/completions addresses), "What does it do?" (required) and "Agent name" (optional). Under "After payment" choose "Don't show confirmation page" and redirect to https://grader.designimp.com/paid/?session={CHECKOUT_SESSION_ID}.
  2. Create a restricted key with "Checkout Sessions: Read" (nothing else). Save it as `S

Only the beginning is shown; read the rest in the repo