Prototype · Preview: every server in the official registry, synced every 30 minutes. Sign in with Google to write reviews.Prototype · updated every 30 min
PopNx MCPMCP servers for people who use AI · explained in plain words Sign in

vidx

by renjithrrkjversion 0.2.1i★ 0iRuns on your computerRepository ↗
Registry nameio.github.renjithrrkj/vidx

How to install

What it does

Local video understanding and editing for agents, in small text instead of frames.

  • Connects Runs on your computer
  • Account or key No key needed
  • Category Design, images & audio

Use together with

Skills that teach the AI this kind of work; they work alongside this one

impeccable

The design vocabulary for your coding agent. Steer with polish and bolder, review with critique and audit, catch AI slop before it ships.

by pbakaus★ 113,5361 skills

Skill · How-to guide

diagram-design

Editorial diagram design for Claude Code, Codex, GitHub Copilot, Cursor, Factory Droid, Qoder, and Pi. 45 diagram types. Self-contained HTML + SVG. No shadows. No Mermaid slop.

by cathrynlavery★ 68,7131 skills

Skill · How-to guide

frontend-slides

Create beautiful slides on the web using a coding agent's frontend skills

by zarazhangrui★ 32,6391 skills

Skill · How-to guide

Why it ranks here

Lists are ordered by a usage score (out of 100) built from these parts

Popularity0/80GitHub stars or weekly downloads: the larger counts 60, the smaller 20
Freshness12/12Full marks for a release or code change within 30 days
Still answering0/8The cloud endpoint answered at the last check
Usage score12/100

Quality: Passed 3/3 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)

Install

Pick the AI app you use, then copy the settings.

Let your AI install it with one sentence

Please install vidx. Follow https://mcp.popnx.com/i/renjithrrkj-vidx.md, show me the commands and wait for my OK before running them.

Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads

Passed 3/3 checks · Runs on your computer · ✓ Commands checked Nov 20, 2026

First: which AI do you use?

Pick your app and the steps appear below.

Works with Claude, with some setup first

Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone

Let AI install it

Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server vidx for Claude on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "vidx": { "command": "uvx", "args": [ "vidx", "mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the vidx tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Open the Claude desktop app’s settings file

    SettingsDeveloperEdit Config

  3. Paste these settings and save the file

    {
      "mcpServers": {
        "vidx": {
          "command": "uvx",
          "args": [
            "vidx",
            "mcp"
          ]
        }
      }
    }
  4. Quit Claude and open it again

  5. Try it

    Use vidx and tell me what you can do for me, then show me one thing

    ✓ If Claude says it is using vidx or shows a vidx tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

ChatGPT cannot connect vidx yet

vidx runs on your computer, but ChatGPT can only connect servers that run on the web

What you can do instead

A · Use an app that can connect vidx

  • Install Python (uv) on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
  • Install Python (uv) on your computer first (one time)
  • Install Python (uv) on your computer first (one time)
  • Install Python (uv) on your computer first (one time)

B · Others in Design, images & audio that work with ChatGPT

Picked from the most used in the same category, only ones that connect by address with no key

Works with Claude Code, with some setup first

Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server vidx for Claude Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user vidx -- uvx vidx mcp 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the vidx tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Open Terminal

    Mac: press Command+Space and type Terminal · Windows: open PowerShell

  3. Paste this command and press Enter

    claude mcp add --scope user vidx -- uvx vidx mcp
  4. Type /mcp in Claude Code

    You should see vidx listed as connected

  5. Try it

    Use vidx and tell me what you can do for me, then show me one thing

    ✓ If Claude Code says it is using vidx or shows a vidx tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor, with some setup first

Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server vidx for Cursor on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "vidx": { "command": "uvx", "args": [ "vidx", "mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the vidx tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Click this button to open Cursor

    Open in Cursor

    Cursor asks you to confirm; click Install

  3. Open the AI chat in Cursor in Agent mode

  4. Try it

    Use vidx and tell me what you can do for me, then show me one thing

    ✓ If Cursor says it is using vidx or shows a vidx tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code, with some setup first

Install Python (uv) on your computer first (one time)

Let AI install it

Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.

Please install the MCP server vidx for VS Code on this computer, in this order: 1) Check uv with uv --version. If it is missing, tell me to install it from https://docs.astral.sh/uv/getting-started/installation/; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "vidx": { "type": "stdio", "command": "uvx", "args": [ "vidx", "mcp" ] } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) No key is needed. 5) Do what we agreed, then check that the vidx tools really show up.

This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.

  1. Install uv (if you don’t have it)

    Already installed? Check first · Open Terminal, type this command and press Enter

    uv --version
    • A version number such as uv … = installed, skip this step
    • "command not found" (on Windows: "is not recognized") = not installed yet, or installed but Terminal needs to be closed and reopened
    How to open Terminal

    Mac: press ⌘ + Space, type Terminal, press Enter

    Windows: open Start, type Windows PowerShell, then Open

    Not installed: uv has no click-through installer. Copy the one-line command for your system (macOS or Windows) from uv’s official page into Terminal · no separate Python install needed; uv downloads it when required

    Open the uv download page ↗

    When it’s done, close Terminal, open it again and run the same command. You should see a version number: uv --version

    Install once; it works for everything that needs uv

  2. Click this button to open VS Code

    Open in VS Code

    VS Code asks you to confirm; click Install

  3. Open the AI chat in VS Code in Agent mode

  4. Try it

    Use vidx and tell me what you can do for me, then show me one thing

    ✓ If VS Code says it is using vidx or shows a vidx tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

JSON settings are under “For developers” below

Stuck? Ask people who use vidx💬 Discussion →
For developers: Terminal commands and JSON settings

Installed on your computer

Claude Code

claude mcp add --scope user vidx -- uvx vidx mcp

Claude Desktop (claude_desktop_config.json)

{
  "mcpServers": {
    "vidx": {
      "command": "uvx",
      "args": [
        "vidx",
        "mcp"
      ]
    }
  }
}

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "vidx": {
      "command": "uvx",
      "args": [
        "vidx",
        "mcp"
      ]
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "vidx": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "vidx",
        "mcp"
      ]
    }
  }
}

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

Downloads per weeki
113/wk
Connection
Runs on your computer
Latest versioni
0.2.1
Published to registryi
Nov 20, 2026
Code last changedi
Nov 20, 2026
Maker
renjithrrkj
Packages
pypi: vidx
Registry status
Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Run on your computer in

ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast

All apps, with pros and cons →

Related guides

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 20, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified with the GitHub account renjithrrkj, which owns the repo

  • ✓ Pass

    Still maintained

    Code last changed today

  • ✓ Pass

    Has a licence

    Uses MIT

  • – Not applicable

    Endpoint responds

    This one runs on your computer; there is no internet endpoint

  • – Not applicable

    Sign-in with OAuth

    Runs on your computer and uses local settings instead

  • … Not checked yet

    No hidden instructions in tool descriptions

    Runs on your computer; we can only read tool lists from internet endpoints

Published vulnerabilities (OSV.dev)

No entries on OSV.dev for vidx@0.2.1

Checks only this package version, not every dependency · checked Nov 20, 2026

What we check → · JSON

Makers: ask for a re-check or report wrong info
For makers: add a badge to your README

If you made this, paste this code into your README. The badge links back to this page.

[![Featured on PopNx MCP](https://mcp.popnx.com/badge/renjithrrkj-vidx.svg)](https://mcp.popnx.com/en/servers/renjithrrkj-vidx)

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

Sign in to post

User reviews

No reviews yet

Sign in to write a review

Compared with others in Design, images & audioi

  • More stars than 0% of the other 3358 servers in this category
  • Published to the registry more recently than 99% of the other 3358 servers in this category
  • Basic checks equal to or better than 99% of the other 3358 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is vidx safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed today, and the latest version (0.2.1) reached the registry today.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Python (uv) on your computer.

What can I use instead?

In the same category: HyperFrames by HeyGen, Pascal 3D Editor, draw.io, Figma MCP Server, Remocn: Remotion MCP server

Similar alternatives

Same category, other makers, commands already checked. Official ones first, then by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

HyperFrames by HeyGen

Official HyperFrames by HeyGen: the best AI video editor in chat. Captions, motion graphics, MP4.

by heygen-comWidely used★ 87.2K Stars for the whole repoUpdated 2 days ago

Runs in the cloud✓ heygen.com

Pascal 3D Editor

Create, inspect, validate, and save editable 3D building scenes with Pascal's MCP server.

by pascalorgWidely used↓ 1K/wk★ 25.7K Stars for the whole repoUpdated 2 days ago

Computer or cloud✓ service owner · pascal.app

draw.io

Create draw.io diagrams in chat from Mermaid or XML, shown live and interactive. 10,000+ shapes.

by jgraphWidely used★ 5.9KUpdated 3 days ago

Runs in the cloud✓ service owner · draw.ioTried by the PopNx team

Figma MCP Server

Figma’s official server gives AI your design data so it can turn designs into code or describe them accurately. Connects to Figma’s cloud.

by figmaWidely used★ 2.2KUpdated 13 months ago

Runs in the cloud✓ service owner · mcp.figma.com
Compared with similar ones
This one
vidx
HyperFrames by HeyGenPascal 3D Editordraw.ioFigma MCP ServerRemocn: Remotion MCP server
Runs whereInstalls on your computerRuns in the cloud, nothing to installCloud or install on your computerRuns in the cloud, nothing to installRuns in the cloud, nothing to installRuns in the cloud, nothing to install
Needs a keyNoNoNoNoNoNo
Add with + in ClaudeNoYesNoNoYesNo
Basic checks3/34/45/54/44/44/4
LicenseMITApache-2.0MITApache-2.0–MIT
PriceNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registryNo cost listed in the registry

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

vidx

Let AI agents edit video without burning tokens on frames.

For an agent to "watch" a 10-minute video at 1 frame per second costs ~67,000 tokens; an hour is ~400,000. vidx watches it once, locally, and gives the agent a compact text map instead: exact shots, keyframes, motion and colour per shot, on-screen text and watermarks, a transcript, speech/music/sfx stretches, beats, and text-searchable visuals. The agent reads a ~600-token overview, searches what it needs, edits with a few lines of script or a timeline file, previews at 480p, renders only what changed, and runs automatic QA. Pixels reach the agent only when it explicitly asks to look (peek).

Runs 100% locally. No paid APIs. Works with any MCP agent (Claude Code, Claude Desktop, …).

Measured on 3 real videos (8, 10, 60 min)transcript + framesvidx
Get the gist of the video7k–17k tokens~650–930
Find a moment, read it, look at it7k–17k~1.4k–1.8k
Cut dead air, render, QA3k–8k~0.8k–1k
Overview of a 10-min vs 60-min videogrows with length507 vs 564

6–18× fewer tokens in these tests, and the gap widens with longer video. Details, method and the cases where it does *not* win: TOKEN_REPORT.md.

Quickstart (Claude Code)

You need ffmpeg and uv:

brew install ffmpeg uv          # Linux: apt install ffmpeg, then curl -LsSf https://astral.sh/uv/install.sh | sh

Then install the plugin inside Claude Code. It adds the server and a skill that tells Claude how to use it:

/plugin marketplace add renjithrrkj/vidx

/plugin install vidx@vidx

Or add just the server: claude mcp add vidx -- uvx vidx mcp. Other MCP clients can find vidx in the MCP Registry as io.github.renjithrrkj/vidx.

No clone needed. Then ask your agent something like *"index ~/Movies/talk.mp4, cut the dead air and make a 9:16 reel of the part where I talk about pricing"*.

The first index downloads Whisper small (~460 MB) and CLIP ViT-B-32 (~600 MB); run vidx setup to fetch them ahead of time. After that vidx never touches the network. The shot detector, OCR and speech detector ship inside their packages. Set VIDX_MODEL_DIR to keep all weights in one folder you can copy. Indexing costs CPU time, not tokens, and stays around 1 GB of RAM.

Claude Desktop / other MCP clients: add to your MCP config (desktop apps don't inherit your shell PATH, so give full paths):

"mcpServers": {

"vidx": { "command": "/full/path/to/uvx", "args": ["--from", "git+https://github.com/renjithrrkj/vidx", "vidx-mcp"], "env": { "PATH": "/opt/homebrew/bin:/usr/local/bin:/usr/bin:/bin" } } }

From source (to hack on it):

git clone https://github.com/renjithrrkj/vidx && cd vidx && uv sync

claude mcp add vidx -- uv run --directory "$PWD" vidx-mcp

Tested on macOS (Apple silicon). Linux should work (CPU/CUDA); Windows is untested.

The tools

ToolWhat it returns
index_video(path, force, captions, glitch)video_id, duration, shots, language, short summary
overview(video_id, level, limit, offset)table of contents (scenes cover the whole video in ≤limit lines)
query(video_id, text, kind, limit)ranked time ranges: speech / visual (CLIP) / on-screen text / event (silence>1.5, music, sfx, beat, laugh, glitch, unclear)
get_segment(video_id, start, end, fields)words, events, shots for one range (wordtimes = per-word stamps; detail = motion curve and peak, colour, audio level, keyframes, text boxes)
peek(target, times, size, grid)image: one contact sheet, ≤4×4 labeled tiles. times=["cuts"] on a version = both sides of every cut + a colour strip of all clips
edit(video_id, dsl, parent_version)DSL or a JSON timeline; version id, segment count, output duration, warnings, timeline file path
render(version_id, preset, out_path, preview)output path, duration, size, pieces encoded vs reused. preview=true = fast 480p
check(version_id)QA report ≤15 lines, OK when clean
diff(version_a, version_b)added / removed / moved source ranges, duration delta

Edit DSL

base all              # start from the full video (default) | base none

drop 30.0-31.2 # remove a time range (also 1:02.5 style) drop s7 # remove a shot (or s7-s9) drop silence>1.2 # remove every silence longer than 1.2s (also: black, freeze, loud) keep 120.0-150.0 # add a range (with base none; line order = output order) keep s3 snap words # move cut points out of words into the nearest gap pad 0.15 # handles around kept segments (never into a neighbouring word) trans xfade 0.3 # crossfade at every join (default: hard cut) crop 9:16 center speed 1.1 match s3 0.8 # colour-match every clip to shot s3 (or a time), strength 0-1 caption 3.0 2.5 Some text # output time, duration, text still photo.jpg 3.0 at 12.5 motion zoom_in fit cover # a still as a clip; at end also works overlay logo.png 3.0 2.5 pos top_right width 0.2 fade 0.3 motion slide_left # image layer; all = to the end sfx impact_01 at 3.2 gain -6 # bundled sound at output time 3.2 music drone_02 gain -18 # bundled bed under the whole edit

Typical dead-air cleanup: drop silence>1.0 / snap words / pad 0.1. edit(..., parent_version="v3") appends to v3's script, so fixes from check are one-liners.

Images

A still is a clip: transitions, captions and check treat it like footage. It has no sound, so add music under it. Motions: none zoom_in zoom_out pan_left pan_right pan_up pan_down. fit cover fills the frame, fit contain shows the whole picture with bars. at is a time in the edit without stills, so adding one doesn't move the others.

An overlay is an image on top of the picture and under captions. Transparent PNGs stay transparent, and a layer can span cuts and transitions. pos is top_left top top_right left center right bottom_left bottom bottom_right or x,y as 0-1 of the frame, width is a share of the frame, and motion is none slide_left slide_right slide_up slide_down.

Anything Pillow reads works (jpg, png, webp). Quote paths with spaces. vidx keeps an upright copy in ~/.vidx/images, so phone photos aren't sideways and an edit still renders if the original moves. In a timeline file, use {"image": "/path/photo.jpg", "for": 3, "motion": "zoom_in"} as a clip, and "overlays": [...] on any clip.

Cuts

So an edit doesn't feel like one trick repeated, vidx has 27 named cuts (vidx cuts lists them):

  • Editorial: hard, smash (with an impact hit), punch_in / punch_big (zoom that hides a jump cut), j_cut / l_cut (sound leads or trails the picture).
  • Transitions: dissolve, dissolve_slow, dip_black, dip_white, flash, whip_left/right/up, zoom, blur, wipe, smooth, cover, reveal, iris, radial, squeeze, slices, wind, pixel, gray_fade.
cuts hype        # a style pack picks each cut from what happens at that join

cuts hype 7 # same pack, different roll cut 3 smash # set one join cut whip_left # set all joins

Packs: clean, documentary, comedy, hype, trailer. They look at each join: same shot on both sides (a jump cut, so punch in), speech crossing it (bridge with a J or L cut), fast motion (whip), a big colour change (dip or flash). They never repeat an effect twice in a row, and hard cuts stay the most common.

Train your own detector

Teach vidx a moment it doesn't know, from time ranges you label:

uv run vidx teach knockdown --pos abcd1234:12-14,abcd1234:88-90,ef012345:30-33 --neg abcd1234:50-70,ef012345:0-20,ef012345:40-60

This trains a small new layer (about 500 weights) on frozen CLIP embeddings plus motion, in under a minute. It reports precision and recall on held-out ranges. Then query(video_id, "knockdown") finds it in any video. When it gets something wrong, add that range to --neg and teach again. Use several videos: a detector taught on one video may learn that video rather than the idea. It sees one frame per second plus motion, so it suits things visible in a frame or a burst of movement, not a split-second contact.

Timeline files

Every edit, DSL or not, compiles to one JSON timeline, saved as ~/.vidx/ /v .timeline.json. Change it and pass it back with edit(id, "@/path/to/file.json"), or write one directly for per-clip control:

{"clips": [

{"in": 12.0, "out": 18.5, "captions": [{"at": 0.5, "for": 2, "text": "Hello"}]}, {"in": 40.0, "out": 44.0, "video": "other_video_id", "speed": 1.2, "grade": {"contrast": 1.05, "match": {"from": 12, "to": 18}}, "transition": {"type": "xfade", "dur": 0.3}}, {"in": 90.0, "out": 95.0}], "audio": [{"sfx": "impact_01", "at": 3.2, "gain": -6}, {"music": "drone_02", "gain": -18}]}

Rendering caches each clip and each transition in ~/.vidx/cache (5 GB, VIDX_CACHE_GB). Change one shot and only that shot re-encodes; the rest is a stream copy. Renders land in vidx_renders/ next to the source (VIDX_OUTPUT_DIR to override).

Sounds: drone_01-06, impact_01-06, riser_01-05, whoosh_01-03. All synthesized by scripts/make_sfx.py, so they ship under this repo's MIT license.

Presets: original (as is), reel_9x16 (1080×1920, −16 LUFS, ≤90 s), yt_16x9 (1920×1080, −14 LUFS).

CLI (same output as the tools)

uv run vidx index ~/Movies/talk.mp4

uv run vidx overview 5450c7a6 uv run vidx query 5450c7a6 "whiteboard diagram" --kind visual uv run vidx segment 5450c7a6 120 150 uv run vidx peek 5450c7a6 "12.5,s3,40" --out sheet.jpg uv run vidx edit 5450c7a6 "drop silence>1.0;snap words;pad 0.1" uv run vidx render v1 --preset reel_9x16 --preview uv run vidx render v1 --preset reel_9x16 uv run vidx peek v1 cuts --out cuts.jpg uv run vidx cuts # the cut library uv run vidx check v1 uv run vidx diff v1 v2 uv run vidx usage # characters returned per call (~tokens)

Optional extras

  • uv sync --extra captions → index_video(..., captions=true) adds Florence-2 one-line shot captions.
  • uv sync --extra otio → every render also writes a .otio timeline (opens in Resolve / Premiere).
  • laugh events (heuristic audience-reaction detector) run by default: query(id, "laugh").
  • index_video(..., glitch=true) scans AI-generated clips for morphing and reports the last clean frame. These are suspects to confirm with peek: expect about one false alarm per handheld phone clip.

Measured (Apple M1, 8 GB, CPU whisper + MPS CLIP)

VideoIndex timeOverview size
10:00 1080p vertical stand-up set (1 take, Malayalam)shots 71 s, visual 23 s, transcript 120 s, audio 64 s ≈ 4.6 min2.6k chars (~650 tok)
7:51 720p short film (124 shots, letterboxed, Malayalam)2.6 min (+5 min with captions)3.0k chars (~760 tok)

A whole session on the 10-min video (23 calls: overviews, queries, segments, edits, 2 peeks) returned ~9.4k chars, roughly 2.3k tokens of text. Rendering the 9:41 silence-cut at 1080×1920 takes ~3 min, a 54 s reel ~10 s.

Malayalam and other languages that Whisper-small transcribes badly are indexed as an English translation (flagged in the summary). Set VIDX_WHISPER_MODEL=large-v3 for native-script transcripts.

A false start followed by a retake can get merged by whisper into one segment, leaving several seconds of real speech with no words and one word stretc

Only the beginning is shown; read the rest in the repo