Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words

Voice Coach

by FabianIMVversion 0.1.1i★ 1iRuns on your computerRepository ↗
Registry nameio.github.FabianIMV/voice-coach-mcp

How to install

What it does

Gives Claude ears: local pitch, pronunciation and public-speaking analysis for voice coaching.

  • Connects Runs on your computer
  • Account or key No key needed
  • Category Other

Why it ranks here

Lists are ordered by a usage score (out of 100) built from these parts

Popularity4/80GitHub stars or weekly downloads: the larger counts 60, the smaller 20
Freshness12/12Full marks for a release or code change within 30 days
Still answering0/8The cloud endpoint answered at the last check
Usage score16/100

Quality: Passed 3/3 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)

Install

Pick the AI app you use, then copy the settings.

Let your AI install it with one sentence

Please install Voice Coach. Follow https://mcp.popnx.com/i/fabianimv-voice-coach-mcp.md, show me the commands and wait for my OK before running them.

Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads

Passed 3/3 checks · Runs on your computer · ✓ Commands checked Nov 14, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude, with some setup first

Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Let AI install it

Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Voice Coach for Claude on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "voice-coach": { "command": "uvx", "args": [ "voice-coach-mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Voice Coach tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Open the Claude desktop app’s settings file

    SettingsDeveloperEdit Config

  3. Paste these settings and save the file

    {
      "mcpServers": {
        "voice-coach": {
          "command": "uvx",
          "args": [
            "voice-coach-mcp"
          ]
        }
      }
    }
  4. Quit Claude and open it again

  5. Try it

    Use Voice Coach and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using Voice Coach or shows a Voice Coach tool in the answer, you are connected

2 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • VOICE_COACH_DIR Folder for recordings, analysis details and progress.md (default ~/VoiceCoach).
  • VOICE_COACH_WHISPER_MODEL Whisper model for transcription and speech metrics (default small).

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect Voice Coach yet

Voice Coach runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect Voice Coach

  • Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
  • Install Python (uv) on your computer first (one time)
  • Install Python (uv) on your computer first (one time)
  • Install Python (uv) on your computer first (one time)

B · Others in Other that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Works with Claude Code, with some setup first

Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Voice Coach for Claude Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user voice-coach -- uvx voice-coach-mcp 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Voice Coach tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  3. Paste this command and press Enter

    claude mcp add --scope user voice-coach -- uvx voice-coach-mcp
  4. Type /mcp in Claude Code

    You should see Voice Coach listed as connected

  5. Try it

    Use Voice Coach and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using Voice Coach or shows a Voice Coach tool in the answer, you are connected

2 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • VOICE_COACH_DIR Folder for recordings, analysis details and progress.md (default ~/VoiceCoach).
  • VOICE_COACH_WHISPER_MODEL Whisper model for transcription and speech metrics (default small).

Descriptions are as written by the maker.

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Voice Coach for Cursor on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "voice-coach": { "command": "uvx", "args": [ "voice-coach-mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Voice Coach tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  3. Open the AI chat in Cursor in Agent mode

  4. Try it

    Use Voice Coach and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using Voice Coach or shows a Voice Coach tool in the answer, you are connected

2 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • VOICE_COACH_DIR Folder for recordings, analysis details and progress.md (default ~/VoiceCoach).
  • VOICE_COACH_WHISPER_MODEL Whisper model for transcription and speech metrics (default small).

Descriptions are as written by the maker.

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server Voice Coach for VS Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "voice-coach": { "type": "stdio", "command": "uvx", "args": [ "voice-coach-mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the Voice Coach tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  3. Open the AI chat in VS Code in Agent mode

  4. Try it

    Use Voice Coach and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using Voice Coach or shows a Voice Coach tool in the answer, you are connected

2 optional setting(s) (works without them)

The command above works without these. Add them only if you want to change something, following the maker’s description.

  • VOICE_COACH_DIR Folder for recordings, analysis details and progress.md (default ~/VoiceCoach).
  • VOICE_COACH_WHISPER_MODEL Whisper model for transcription and speech metrics (default small).

Descriptions are as written by the maker.

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use Voice Coach💬 Discussion →
For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add --scope user voice-coach -- uvx voice-coach-mcp

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "voice-coach": {
      "command": "uvx",
      "args": [
        "voice-coach-mcp"
      ]
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "voice-coach": {
      "command": "uvx",
      "args": [
        "voice-coach-mcp"
      ]
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "voice-coach": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "voice-coach-mcp"
      ]
    }
  }
}

Values you fill in

  • VOICE_COACH_DIR env
    Folder for recordings, analysis details and progress.md (default ~/VoiceCoach).
  • VOICE_COACH_WHISPER_MODEL env
    Whisper model for transcription and speech metrics (default small).

Descriptions are as written by the maker.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
50/wk
Connection
Runs on your computer
Latest versioni
0.1.1
Categoryi
Other
Published to registryi
Oct 23, 2026
Code last changedi
Nov 18, 2026
Maker
FabianIMV
Packages
pypi: voice-coach-mcp
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast

All apps, with pros and cons →

Related guides

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 19, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified with the GitHub account fabianimv, which owns the repo

  • ✓ Pass

    Still maintained

    Code last changed yesterday

  • ✓ Pass

    Has a licence

    Uses MIT

  • – Not applicable

    Endpoint responds

    This one runs on your computer; there is no internet endpoint

  • – Not applicable

    Sign-in with OAuth

    Runs on your computer and uses local settings instead

  • … Not checked yet

    No hidden instructions in tool descriptions

    Runs on your computer; we can only read tool lists from internet endpoints

Published vulnerabilities (OSV.dev)

No entries on OSV.dev for voice-coach-mcp@0.1.1

Checks only this package version, not every dependency · checked Nov 15, 2026

What we check → · JSON

Makers: ask for a re-check or report wrong info
For makers: add a badge to your README

If you made this, paste this code into your README. The badge links back to this page.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/fabianimv-voice-coach-mcp.svg)](https://mcp.popnx.com/en/servers/fabianimv-voice-coach-mcp)

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Otheri

  • More stars than 86% of the other 20693 servers in this category
  • Published to the registry more recently than 62% of the other 20693 servers in this category
  • Basic checks equal to or better than 99% of the other 20693 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Voice Coach safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed yesterday, and the latest version (0.1.1) reached the registry 27 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Python (uv) on your computer.

What can I use instead?

In the same category: World Monitor, openstatus, Oh My Posh Validator, Strata, Jitsu

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

World Monitor

Real-time global intelligence on conflict, markets, energy, trade, shipping and cyber. 100 tools.

by koala73Widely used★ 90.9KUpdated 3 days ago

Runs in the cloud✓ service owner · worldmonitor.app

openstatus

Manage monitors, status pages, incidents and maintenances in your openstatus workspace.

by openstatusHQWidely used★ 9.3KUpdated 2 months ago

Runs in the cloud✓ service owner · openstatus.dev

Oh My Posh Validator

Validate oh-my-posh configurations and segment snippets against the official schema.

by JanDeDobbeleerWidely used★ 23.8K Stars for the whole repoUpdated 30 days ago

Runs in the cloud✓ service owner · ohmyposh.dev

Strata

MCP server for progressive tool usage at any scale (see https://klavis.ai)

by Klavis-AIGrowing★ 5.8KUpdated 14 months ago

Runs in the cloudRepo archived✓ klavis.ai

Jitsu

Manage Jitsu data pipelines: destinations, streams, connections, functions, live events.

by jitsucomWidely used★ 5.1KUpdated 4 months ago

Runs in the cloud✓ service owner · jitsu.com
Compared with similar ones
This one
Voice Coach
World MonitoropenstatusOh My Posh ValidatorStrataJitsu
Runs whereInstalls on your computerRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to install
Needs a keyNoNoNoNoNoNo
Add with + in ClaudeNoNoNoNoNoNo
Basic checks3/34/44/44/41/44/4
LicenseMITAGPL-3.0AGPL-3.0MITApache-2.0MIT
PriceNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registry

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

voice-coach-mcp

Give Claude ears. A local MCP server that listens to you sing, speak and read aloud, measures what it hears, and lets Claude coach your voice.

Claude cannot process audio. This server records from your microphone, analyzes the audio on your computer, and returns compact measurements that Claude turns into concrete coaching:

ModeWhat it measures
🎤 SingingPitch accuracy per note (cents), flat/sharp tendency, drift, stability and vibrato. Compares against equal temperament, a key, or a MIDI melody, including wrong, missed and late notes.
🗣️ English pronunciationPhoneme-level comparison of what you said against what you meant to read, with per-word scores and frequent confusions (θ → s, v → b, iː → ɪ…).
🎙️ Public speakingWords per minute, long pauses, filler words (English and Spanish), pitch monotony and volume variation, with a timestamped transcript.

A bundled skill turns Claude into a coach: it runs warm-up → exercise → analysis → feedback sessions, gives one concrete focus per take, and keeps a progress log across sessions. Claude replies in your language.

  • Local and private: audio never leaves your computer (unless you opt into the Azure backend).
  • Free: open-source models (faster-whisper, wav2vec2) and no API keys.
  • Tools measure, Claude interprets: every response is compact JSON (≤ 2 KB) with confidence and warnings, so Claude never coaches on bad audio.

Install

You need uv and, for pronunciation, espeak-ng:

brew install uv espeak-ng ffmpeg        # macOS (ffmpeg is optional: m4a/aac input)

On Linux: install uv, then sudo apt install espeak-ng ffmpeg libportaudio2. Pronunciation analysis on macOS needs Apple Silicon and macOS 14 or later (a PyTorch requirement).

Claude Code (plugin: server + skill)
claude plugin marketplace add FabianIMV/voice-coach-mcp

claude plugin install voice-coach@voice-coach

Or, inside a session: /plugin install voice-coach --marketplace FabianIMV/voice-coach-mcp.

The first start installs the Python dependencies with uv, which can take a minute or two (the models download later, on first use). If /mcp shows voice-coach as failed right after installing, reconnect it from /mcp once the installation finishes.

Claude Desktop (extension)

Download voice-coach.mcpb from the latest release and double-click it (or drag it into Claude Desktop). For the coaching skill, also download voice-coach-skill.zip and upload it in Settings → Capabilities → Skills.

Any MCP client (manual)
claude mcp add voice-coach --scope user -- uvx --from "voice-coach-mcp[speech,pronunciation]" voice-coach-mcp

For Claude Desktop's claude_desktop_config.json, use absolute paths (Desktop does not inherit your shell PATH; which uvx prints it):

{

"mcpServers": { "voice-coach": { "command": "/opt/homebrew/bin/uvx", "args": ["--from", "voice-coach-mcp[speech,pronunciation]", "voice-coach-mcp"] } } }

Optional: run uvx --from "voice-coach-mcp[speech,pronunciation]" voice-coach-mcp download-models once, so the first call does not wait for the models (~480 MB Whisper, ~1.3 GB phoneme model).

Microphone permission (macOS)

macOS grants the microphone to the app that launches the server: Claude Desktop, or the terminal running Claude Code (Terminal, iTerm, Ghostty, VS Code…). If permission is denied, macOS returns silence instead of an error and record_audio reports no_microphone_permission. Fix it in System Settings → Privacy & Security → Microphone and restart that app.

Use it

Just talk to Claude:

  • *"I want to practice singing in tune. I'm a beginner."*
  • *"Record 30 seconds of me presenting my project and tell me how many filler words I use."*
  • *"Help me pronounce 'th'. Give me sentences to read and score them."*
  • *"Analyze this voice memo against melody.mid"* (any wav/mp3/m4a path works).
  • *"How am I doing?"* (Claude reads your progress log).

Real sessions in Claude Code: a 60-second talk about work, and a singing baseline on one held note.

Guided sessions are also available as MCP prompts: singing_session, pronunciation_session and speaking_session (in Claude Code: /mcp__voice-coach__singing_session).

Tools

ToolPurpose
record_audio(seconds, name?)Records a 16 kHz mono WAV to ~/VoiceCoach/recordings/ and reports levels, clipping and noise.
analyze_pitch(audio, reference_midi?, key?, midi_track?)Pitch accuracy per note against equal temperament, a key ("A minor", "G major"…) or a MIDI melody.
transcribe(audio, language?)Local transcription with segment and word timestamps.
speech_metrics(audio, language, pause_threshold_s=0.7)Pace, long pauses, filler words, pitch monotony and volume variation.
assess_pronunciation(audio, expected_text, language="en-US")Phoneme-level English pronunciation scores and errors.
read_progress(entries=5) / log_progress(entry)Read and append sessions in ~/VoiceCoach/progress.md.

Audio can be a path or the name returned by record_audio. When a result is too long, the most relevant items are returned and everything else is saved next to the audio (full_details).

Example: analyze_pitch on a synthetic C major scale with known deviations

{"audio":"examples/audio/c_major_scale.wav","duration_s":7.36,"mode":"equal_temperament",

"summary":{"notes":8,"range":"C4–C5","pct_within_25_cents":75.0,"mean_deviation_cents":-7.8, "mean_abs_deviation_cents":13.6,"tendency":"centered","drift_cents":-1.0, "stability":{"stable":7,"vibrato":1,"unstable":0}}, "notes":[{"t":0.4,"dur":0.62,"note":"C4","cents":0,"stability":"stable"}, {"t":1.84,"dur":0.62,"note":"E4","cents":-30,"stability":"stable"}, {"t":4.72,"dur":0.62,"note":"B4","cents":-42,"stability":"stable"}, {"t":5.44,"dur":1.43,"note":"C5","cents":-2,"stability":"vibrato","vibrato_hz":5.5,"vibrato_pp_cents":84}, "…"], "confidence":{"value":1.0,"level":"high"},"warnings":[]}

With a MIDI reference, the server detects that the melody was sung an octave lower (octave_shift: -1), started 1 s late (start_offset_ms: 1003), and that one note came in 134 ms late.

Example: assess_pronunciation — "I s ink the b erry best s ings…" read for "I think the very best things in life are free"

{"backend":"wav2vec2-local",

"summary":{"overall_score":90,"words":10,"words_with_errors":3, "errors":{"substitution":3,"deletion":0,"insertion":0}, "frequent_confusions":[{"expected":"θ","detected":"s","count":2},{"expected":"v","detected":"b","count":1}]}, "words":[{"word":"think","score":75,"t":0.56,"expected":"θ ɪ ŋ k","detected":"s ɪ ŋ k", "errors":[{"type":"substitution","expected":"θ","detected":"s"}]}, {"word":"very","score":75,"t":0.96,"expected":"v ɛ ɹ i","detected":"b ɛ ɹ i", "errors":[{"type":"substitution","expected":"v","detected":"b"}]}, "…"], "confidence":{"value":1.0,"level":"high"},"warnings":[]}

</details>

Example: speech_metrics on a short synthetic talk with inserted pauses and fillers

{"language":"en",

"pace":{"words":36,"speaking_time_s":14.9,"words_per_minute":145,"wpm_excluding_long_pauses":165}, "pauses":{"threshold_s":0.7,"count":2,"total_s":1.9,"max_s":1.03,"per_minute":8.1, "items":[{"t":4.42,"dur":1.03,"after":"speaking"},{"t":12.1,"dur":0.83,"after":"normal"}]}, "fillers":{"total":6,"per_minute":24.2,"by_type":{"um":1,"so":1,"uh":1,"you know":1,"like":1,"i mean":1}}, "pitch":{"median_f0_hz":101,"std_semitones":1.53,"monotone":true,"monotone_stretches":[{"t":0.0,"end":12.0}]}, "volume":{"mean_dbfs":-21.2,"std_between_words_db":2.4,"low_variation":true}, "confidence":{"value":1.0,"level":"high"},"warnings":[]}

The synthetic voice is very flat, hence monotone: true. A Spanish example is also included.

All example outputs are real responses from the server over stdio, regenerated by examples/generate_examples.py on synthetic audio; see examples/outputs/.

How it works

  • Pitch: pYIN (librosa) finds voiced frames; each frame is refined from its harmonic peaks with parabolic interpolation (~1 cent accuracy from C2 to C6). Notes are split at silences, energy dips and sustained pitch changes; vibrato does not split notes. With a MIDI reference, the octave and offset are found by cross-correlation, notes are aligned with Needleman–Wunsch, and a tempo line t_sung = a·t_ref + b is fitted to judge each onset.
  • Speech: faster-whisper transcribes with word timestamps (an initial prompt keeps fillers). Pauses are measured from the audio energy, because Whisper stretches word endings into silence. Ambiguous fillers ("like", "so") only count when isolated by a comma or a pause.
  • Pronunciation: phonemizer + espeak-ng give the expected IPA phonemes; the facebook/wav2vec2-lv-60-espeak-cv-ft phoneme model gives what was said; both are aligned by edit distance. Normal American English variants (flap, schwa, linking r, glottal stop) are not counted as errors.
  • Quality first: clipping, background noise, silence and missing microphone permission are reported as warnings and lower the confidence.

Known limitations: one voice at a time (accompaniment degrades pitch detection); two identical notes sung in perfect legato count as one; the phoneme model uses sentence context and may occasionally "correct" a mispronounced word; pronunciation assessment is English-only.

Privacy and network access

Everything the plugin runs, writes and downloads:

  • Runs: uv starts the server from the plugin folder (uv run --frozen, pinned by uv.lock); the server uses espeak-ng for expected phonemes and ffmpeg only to read m4a/aac files.
  • Microphone: only while record_audio runs, for the number of seconds Claude asks for.
  • Writes: record

Only the beginning is shown; read the rest in the repo