Prototipo · Versión preliminar: todos los servidores del registro oficial, sincronizados cada 30 minutos. Inicia sesión con Google para escribir reseñas.Prototipo · se actualiza cada 30 min
PopNx MCPServidores MCP para quienes usan IA · en palabras sencillas

evals-skills Skill

Repositorio ↗

de ai-evals-course★ 1823 (whole repo)9 skills

★ Stars are for the whole repo, not each skill

Pick the skill to install

What it does

This repo is a collection of 9 skills; it is a guide with example skills

  • Connects Instruction files the AI reads
  • Account or key No key found in README or SKILL.md
  • Category Programación
Maker’s original description
Skills that guide AI coding agents to help you build product-specific AI evals.
Para autores: añade una insignia a tu README

Si lo creaste tú, pega este código en tu README. La insignia enlaza a esta página.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/skill/ai-evals-course-evals-skills.svg)](https://mcp.popnx.com/en/skills/ai-evals-course-evals-skills)

Úsalo junto con

Servidores MCP que conectan la IA a servicios para el mismo trabajo

REA

Reverse engineer anything from your terminal or agent with one CLI and MCP server.

de morlutoMuy usado↓ 388,7 mil/sem★ 468,8 milActualizado hace 7 días

MCP · Conecta un servicioSe ejecuta en tu computadora

Fallow

Codebase intelligence for TypeScript and JavaScript, exposed as structured MCP analysis tools.

de fallow-rsMuy usado↓ 2,4 M/sem★ 5,4 milActualizado anteayer

MCP · Conecta un servicioSe ejecuta en tu computadora

Desktop Commander

MCP server for terminal commands, file operations, and process management

de wonderwhy-erMuy usado↓ 740,3 mil/sem★ 10,4 milActualizado ayer

MCP · Conecta un servicioSe ejecuta en tu computadora

Skills parecidas

Mismo tipo de trabajo, ordenadas como la lista de Skills

Comparado con otros parecidos
Este
evals-skills
reaandrej-karpathy-skillsgraphifyMoneyPrinterTurbo
Autorai-evals-coursemorlutomultica-aiGraphify-Labsharry0703
Skills91111
Estrellas de GitHub1823468.733234.332150.287144.566
Último cambio de código25 oct 202619 nov 202620 abr 202618 nov 202618 nov 2026
LicenciaApache-2.0MIT–Apache-2.0MIT

9 skills (conjuntos de instrucciones) de ai-evals-course que la IA lee y sigue · no es un MCP server

Pick the skill to install

Install only the ones you use. Open a skill to see how to install it

Install the whole set (9)

If you want every one, let the AI install them in one go. Know 2 things first

  • Every installed skill’s description is loaded into every chat. The more you install, the easier it is for the AI to pick the wrong one
  • Some skills duplicate tools the AI already has built in. Installing only the ones you use works better
Where to install
Please install all 9 skills from https://github.com/ai-evals-course/evals-skills: build-review-interface, error-discovery, eval-audit, evals-start, evaluate-rag, generate-synthetic-data, validate-evaluator, write-code-eval, write-judge-prompt, for all my projects, putting each at ~/.claude/skills/<skill name> (in Codex use ~/.agents/skills/<skill name>, in Cursor ~/.cursor/skills/<skill name>). Folders in the repo: build-review-interface = skills/build-review-interface · error-discovery = skills/error-discovery · eval-audit = skills/eval-audit · evals-start = skills/evals-start · evaluate-rag = skills/evaluate-rag · generate-synthetic-data = skills/generate-synthetic-data · validate-evaluator = skills/validate-evaluator · write-code-eval = skills/write-code-eval · write-judge-prompt = skills/write-judge-prompt. First show me every file and tell me whether any has scripts or changes machine settings, then tell me the full path you will install each one to and wait for me to agree.
Please install all 9 skills from https://github.com/ai-evals-course/evals-skills: build-review-interface, error-discovery, eval-audit, evals-start, evaluate-rag, generate-synthetic-data, validate-evaluator, write-code-eval, write-judge-prompt, into the project this chat is open in (at .claude/skills/<skill name>; in Codex use .agents/skills/<skill name>, in Cursor .cursor/skills/<skill name>). Folders in the repo: build-review-interface = skills/build-review-interface · error-discovery = skills/error-discovery · eval-audit = skills/eval-audit · evals-start = skills/evals-start · evaluate-rag = skills/evaluate-rag · generate-synthetic-data = skills/generate-synthetic-data · validate-evaluator = skills/validate-evaluator · write-code-eval = skills/write-code-eval · write-judge-prompt = skills/write-judge-prompt. First show me every file and tell me whether any has scripts or changes machine settings, then tell me the project name and the full path you will install each one to and wait for me to agree.

Uploading to Claude on the web and apps: you need 9 uploads, one ZIP per skill. Open each skill in the list below to download it

Checked against official docs 12 nov 2026 · Source: support.claude.com, code.claude.com, learn.chatgpt.com, cursor.com

  • build-review-interface

    Build a custom browser-based annotation interface tailored to your data for reviewing LLM traces and collecting structured feedback. Use when you need to build an annotation tool, review traces, or collect human labels.

  • error-discovery

    Run error analysis on a dataset. Build a review UI, select diverse samples, monitor annotations, and organize failure modes.

  • eval-audit

    Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when unsure whether evals are trustworthy, or as a starting point when no eval infrastructure exists. Do NOT use when the goal is to build a new eval…

  • evals-start

    Entry point for evals. Use when the user asks for help with evals, does not know where to begin, or asks for something no other skill in this plugin matches. Do NOT use when a more specific skill in this plugin already matches; load that skill directly.

  • evaluate-rag

    Guides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, assessing generation faithfulness or relevance, generating synthetic QA pairs for retrieval testing, or optimizing chunking strategies.

  • generate-synthetic-data

    Create diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation. Use when bootstrapping an eval dataset, when real user data is sparse, or when stress-testing specific failure hypotheses. Do NOT use when you already have 100+ representative real traces (use s…

  • validate-evaluator

    Calibrate an LLM judge against human labels using data splits, TPR/TNR, and bias correction. Use after writing a judge prompt (write-judge-prompt) when you need to verify alignment before trusting its outputs. Do NOT use for code-based evaluators (those are deterministic; test with unit tests per `…

  • write-code-eval

    Write code evaluators for known failure modes with objective rules. Use when code can check the rule from a trace, with or without a reference answer. Use `write-judge-prompt` when the rule requires interpretation.

  • write-judge-prompt

    Design LLM-as-Judge evaluators for subjective criteria that code-based checks cannot handle. Use when a failure mode requires interpretation (tone, faithfulness, relevance, completeness). Do NOT use when the failure mode can be checked with code (regex, schema validation, execution tests); use `wri…

En qué se diferencia un Skill de MCP

MCP = las manos

Conecta la IA a un servicio o dato externo, como leer Notion o crear una factura. Necesita un programa o servidor en marcha.

Skill = el manual

Un archivo de texto que enseña a la IA cómo hacer una tarea. No se conecta a nada.

A veces se parecen: algunas Skills ejecutan scripts que llaman herramientas y algunos MCP solo envían conocimiento. Empieza por la tarea que quieres hacer.

Funciona con

El autor no lo indica · los skills con SKILL.md funcionan en apps compatibles con Agent Skills, como Claude Code, Codex y Cursor

Instalar

Pick a skill first

This repo has 9 skills. Pick one from the list above; its page shows every way to install it, including letting the AI install it and a ZIP

Let the AI install it
Upload to claude.ai

Go to the skill list ↑

The maker’s command installs the whole set of 9
Instala Node.js (si no lo tienes)

¿Ya está instalado? Compruébalo primero · Abre la Terminal, escribe este comando y pulsa Enter

node -v
  • Aparece un número de versión, p. ej. v26.13.1 = ya está instalado, sáltate este paso
  • Aparece "command not found" (en Windows, "is not recognized") = aún no está instalado, o acabas de instalarlo y debes cerrar y volver a abrir la Terminal
Cómo abrir la Terminal

Mac: pulsa ⌘ + Espacio, escribe Terminal y pulsa Enter

Windows: abre Inicio, escribe Windows PowerShell y elige Abrir

Si no está instalado: Abre la página oficial de descargas, elige la versión LTS y el instalador de clics: .pkg en Mac · .msi en Windows. Haz doble clic y sigue hasta el final. No necesitas ningún comando curl

Abrir la página de descarga de Node.js ↗

Al terminar, cierra la Terminal, ábrela de nuevo y ejecuta el mismo comando. Debe aparecer un número de versión: node -v

Se instala una vez y sirve para todo lo que usa Node.js

npx skills add https://github.com/ai-evals-course/evals-skills

Copiado del README del autor; descarga y ejecuta su código

Conversación

Pregunta, comparte un consejo o avisa de que no funciona. Ordenado por lo que la gente marcó como útil.

Aún no hay publicaciones. Sé la primera persona en preguntar o compartir.

Lo publicado aquí lo escriben usuarios, no el equipo de PopNx.

Inicia sesión para publicar

Desde GitHub

Estrellas en GitHub
1823
Stars are for the whole repo, not each skill
Autor
ai-evals-course
Licencia
Apache-2.0
Último cambio de código
25 oct 2026
Archivos SKILL.md del repo (con traducciones y plantillas)
9