impeccable
The design vocabulary for your coding agent. Steer with polish and bolder, review with critique and audit, catch AI slop before it ships.
Let AI agents watch videos and answer questions about them through any OpenAI-compatible endpoint.
Skills that teach the AI this kind of work; they work alongside this one
The design vocabulary for your coding agent. Steer with polish and bolder, review with critique and audit, catch AI slop before it ships.
Editorial diagram design for Claude Code, Codex, GitHub Copilot, Cursor, Factory Droid, Qoder, and Pi. 45 diagram types. Self-contained HTML + SVG. No shadows. No Mermaid slop.
Create beautiful slides on the web using a coding agent's frontend skills
Lists are ordered by a usage score (out of 100) built from these parts
| Popularity | 0/80 | GitHub stars or weekly downloads: the larger counts 60, the smaller 20 |
|---|---|---|
| Freshness | 12/12 | Full marks for a release or code change within 30 days |
| Still answering | 0/8 | The cloud endpoint answered at the last check |
| Usage score | 12/100 |
Quality: Passed 3/3 basic checks (shown, not used for ordering) · Momentum: No data yet (Used only on the Trending tab)
Pick the AI app you use, then copy the settings.
Let your AI install it with one sentence
Please install Video Understanding MCP. Follow https://mcp.popnx.com/i/granitebps-video-understanding-mcp.md, show me the commands and wait for my OK before running them.Paste it into an AI that can work on your computer (such as Claude Code or Cursor). It reads our steps, shows you the commands and waits for your OK. No key, no sign-up. · See the full text your AI reads
Passed 3/3 checks · Runs on your computer · ✓ Commands checked Nov 14, 2026
First: which AI do you use?
Pick your app and the steps appear below.
Copy this message into a Claude chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.
Please install the MCP server Video Understanding MCP for Claude on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "video-understanding": { "command": "npx", "args": [ "-y", "@granitebps/video-understanding-mcp" ], "env": { "VIDEO_BASE_URL": "your-value", "VIDEO_MODEL": "your-value", "VIDEO_API_KEY": "your-value", "VIDEO_EXTRA_HEADERS": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For VIDEO_API_KEY, VIDEO_EXTRA_HEADERS, VIDEO_BASE_URL, VIDEO_MODEL, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Video Understanding MCP tools really show up.This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.
Already installed? Check first · Open Terminal, type this command and press Enter
node -vMac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.
How to get a key is in the maker’s README below
These are program settings, not keys. No sign-up needed; fill them in as the maker describes.
VIDEO_BASE_URL Base URL of an OpenAI-compatible chat completions endpoint whose model accepts video, e.g. https://host/v1VIDEO_MODEL Model (or router alias) to send videos toDescriptions are as written by the maker.
SettingsDeveloperEdit Config
{
"mcpServers": {
"video-understanding": {
"command": "npx",
"args": [
"-y",
"@granitebps/video-understanding-mcp"
],
"env": {
"VIDEO_BASE_URL": "your-value",
"VIDEO_MODEL": "your-value",
"VIDEO_API_KEY": "your-value",
"VIDEO_EXTRA_HEADERS": "your-value"
}
}
}
}Paste the key only into the app’s field, never into a chat or to anyone
Use Video Understanding MCP and tell me what you can do for me, then show me one thing✓ If Claude says it is using Video Understanding MCP or shows a Video Understanding MCP tool in the answer, you are connected
The command above works without these. Add them only if you want to change something, following the maker’s description.
VIDEO_PART_FORMAT How the video is attached: video_url, image_url, file, or input_file · default image_urlVIDEO_MAX_DURATION_SECONDS Longest analyzed range in seconds · default 300VIDEO_MAX_UPLOAD_MB Largest prepared video sent to the endpoint, in MB · default 15VIDEO_ALLOWED_DIRS Directories local files may be read from; local files are refused when unsetVIDEO_VERIFY_MEDIA Fail calls when the endpoint evidently ignored the video · default trueDescriptions are as written by the maker.
Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version
ChatGPT cannot connect Video Understanding MCP yet
Video Understanding MCP runs on your computer, but ChatGPT can only connect servers that run on the web
A · Use an app that can connect Video Understanding MCP
B · Others in Design, images & audio that work with ChatGPT
Picked from the most used in the same category, only ones that connect by address with no key
Works with Claude Code, with some setup first
You need a Video Understanding MCP key (create it on the maker’s site) · 2 setting(s) to fill in (VIDEO_BASE_URL, VIDEO_MODEL) · Install Node.js on your computer first (one time)
Copy this message into a Claude Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.
Please install the MCP server Video Understanding MCP for Claude Code on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): claude mcp add --scope user video-understanding --env VIDEO_BASE_URL=your-value --env VIDEO_MODEL=your-value --env VIDEO_API_KEY=your-value --env VIDEO_EXTRA_HEADERS=your-value -- npx -y @granitebps/video-understanding-mcp 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For VIDEO_API_KEY, VIDEO_EXTRA_HEADERS, VIDEO_BASE_URL, VIDEO_MODEL, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Video Understanding MCP tools really show up.This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.
Already installed? Check first · Open Terminal, type this command and press Enter
node -vMac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.
How to get a key is in the maker’s README below
These are program settings, not keys. No sign-up needed; fill them in as the maker describes.
VIDEO_BASE_URL Base URL of an OpenAI-compatible chat completions endpoint whose model accepts video, e.g. https://host/v1VIDEO_MODEL Model (or router alias) to send videos toDescriptions are as written by the maker.
Mac: press Command+Space and type Terminal · Windows: open PowerShell
claude mcp add --scope user video-understanding --env VIDEO_BASE_URL=your-value --env VIDEO_MODEL=your-value --env VIDEO_API_KEY=your-value --env VIDEO_EXTRA_HEADERS=your-value -- npx -y @granitebps/video-understanding-mcpReplace “your-value” with your key before pressing Enter
Paste the key only into the app’s field, never into a chat or to anyone
You should see Video Understanding MCP listed as connected
Use Video Understanding MCP and tell me what you can do for me, then show me one thing✓ If Claude Code says it is using Video Understanding MCP or shows a Video Understanding MCP tool in the answer, you are connected
The command above works without these. Add them only if you want to change something, following the maker’s description.
VIDEO_PART_FORMAT How the video is attached: video_url, image_url, file, or input_file · default image_urlVIDEO_MAX_DURATION_SECONDS Longest analyzed range in seconds · default 300VIDEO_MAX_UPLOAD_MB Largest prepared video sent to the endpoint, in MB · default 15VIDEO_ALLOWED_DIRS Directories local files may be read from; local files are refused when unsetVIDEO_VERIFY_MEDIA Fail calls when the endpoint evidently ignored the video · default trueDescriptions are as written by the maker.
Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version
Works with Cursor, with some setup first
You need a Video Understanding MCP key (create it on the maker’s site) · 2 setting(s) to fill in (VIDEO_BASE_URL, VIDEO_MODEL) · Install Node.js on your computer first (one time)
Copy this message into a Cursor chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.
Please install the MCP server Video Understanding MCP for Cursor on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "mcpServers": { "video-understanding": { "command": "npx", "args": [ "-y", "@granitebps/video-understanding-mcp" ], "env": { "VIDEO_BASE_URL": "your-value", "VIDEO_MODEL": "your-value", "VIDEO_API_KEY": "your-value", "VIDEO_EXTRA_HEADERS": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For VIDEO_API_KEY, VIDEO_EXTRA_HEADERS, VIDEO_BASE_URL, VIDEO_MODEL, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Video Understanding MCP tools really show up.This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.
Already installed? Check first · Open Terminal, type this command and press Enter
node -vMac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.
How to get a key is in the maker’s README below
These are program settings, not keys. No sign-up needed; fill them in as the maker describes.
VIDEO_BASE_URL Base URL of an OpenAI-compatible chat completions endpoint whose model accepts video, e.g. https://host/v1VIDEO_MODEL Model (or router alias) to send videos toDescriptions are as written by the maker.
In the Video Understanding MCP settings, VIDEO_API_KEY, VIDEO_EXTRA_HEADERS, VIDEO_BASE_URL, VIDEO_MODEL is empty; add your key and save
Paste the key only into the app’s field, never into a chat or to anyone
Use Video Understanding MCP and tell me what you can do for me, then show me one thing✓ If Cursor says it is using Video Understanding MCP or shows a Video Understanding MCP tool in the answer, you are connected
The command above works without these. Add them only if you want to change something, following the maker’s description.
VIDEO_PART_FORMAT How the video is attached: video_url, image_url, file, or input_file · default image_urlVIDEO_MAX_DURATION_SECONDS Longest analyzed range in seconds · default 300VIDEO_MAX_UPLOAD_MB Largest prepared video sent to the endpoint, in MB · default 15VIDEO_ALLOWED_DIRS Directories local files may be read from; local files are refused when unsetVIDEO_VERIFY_MEDIA Fail calls when the endpoint evidently ignored the video · default trueDescriptions are as written by the maker.
Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version
Works with VS Code, with some setup first
You need a Video Understanding MCP key (create it on the maker’s site) · 2 setting(s) to fill in (VIDEO_BASE_URL, VIDEO_MODEL) · Install Node.js on your computer first (one time)
Copy this message into a VS Code chat. The AI checks your computer, tells you which file it will change, and waits for your OK every time.
Please install the MCP server Video Understanding MCP for VS Code on this computer, in this order: 1) Check Node.js with node -v. If it is missing, tell me to install it from https://nodejs.org/en/download; do not install it yourself. 2) Use only this config (already checked by PopNx MCP): { "servers": { "video-understanding": { "type": "stdio", "command": "npx", "args": [ "-y", "@granitebps/video-understanding-mcp" ], "env": { "VIDEO_BASE_URL": "your-value", "VIDEO_MODEL": "your-value", "VIDEO_API_KEY": "your-value", "VIDEO_EXTRA_HEADERS": "your-value" } } } } 3) Tell me the full path of the file you will change, or the command you will run, and wait for my OK. 4) For VIDEO_API_KEY, VIDEO_EXTRA_HEADERS, VIDEO_BASE_URL, VIDEO_MODEL, leave "your-value" in place and tell me to paste the real value myself into the file or the app’s field. Never ask me to type a key in chat. 5) Do what we agreed, then check that the Video Understanding MCP tools really show up.This message has no key in it. If a key is needed, the AI will ask you to paste it yourself into the file or the app’s field.
Already installed? Check first · Open Terminal, type this command and press Enter
node -vMac: press ⌘ + Space, type Terminal, press Enter
Windows: open Start, type Windows PowerShell, then Open
Not installed: Open the official download page, pick the LTS version and the click-through installer: .pkg on Mac · .msi on Windows. Double-click and follow it to the end. No curl command needed
Open the Node.js download page ↗
When it’s done, close Terminal, open it again and run the same command. You should see a version number: node -v
Install once; it works for everything that needs Node.js
Open the maker’s site, sign up and create an API key for the next step. Check the maker’s site for pricing and free plans.
How to get a key is in the maker’s README below
These are program settings, not keys. No sign-up needed; fill them in as the maker describes.
VIDEO_BASE_URL Base URL of an OpenAI-compatible chat completions endpoint whose model accepts video, e.g. https://host/v1VIDEO_MODEL Model (or router alias) to send videos toDescriptions are as written by the maker.
In the Video Understanding MCP settings, VIDEO_API_KEY, VIDEO_EXTRA_HEADERS, VIDEO_BASE_URL, VIDEO_MODEL is empty; add your key and save
Paste the key only into the app’s field, never into a chat or to anyone
Use Video Understanding MCP and tell me what you can do for me, then show me one thing✓ If VS Code says it is using Video Understanding MCP or shows a Video Understanding MCP tool in the answer, you are connected
The command above works without these. Add them only if you want to change something, following the maker’s description.
VIDEO_PART_FORMAT How the video is attached: video_url, image_url, file, or input_file · default image_urlVIDEO_MAX_DURATION_SECONDS Longest analyzed range in seconds · default 300VIDEO_MAX_UPLOAD_MB Largest prepared video sent to the endpoint, in MB · default 15VIDEO_ALLOWED_DIRS Directories local files may be read from; local files are refused when unsetVIDEO_VERIFY_MEDIA Fail calls when the endpoint evidently ignored the video · default trueDescriptions are as written by the maker.
Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version
Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.
JSON settings are under “For developers” below
Claude Code
claude mcp add --scope user video-understanding --env VIDEO_BASE_URL=your-value --env VIDEO_MODEL=your-value --env VIDEO_API_KEY=your-value --env VIDEO_EXTRA_HEADERS=your-value -- npx -y @granitebps/video-understanding-mcpClaude Desktop (claude_desktop_config.json)
{
"mcpServers": {
"video-understanding": {
"command": "npx",
"args": [
"-y",
"@granitebps/video-understanding-mcp"
],
"env": {
"VIDEO_BASE_URL": "your-value",
"VIDEO_MODEL": "your-value",
"VIDEO_API_KEY": "your-value",
"VIDEO_EXTRA_HEADERS": "your-value"
}
}
}
}Cursor (~/.cursor/mcp.json)
{
"mcpServers": {
"video-understanding": {
"command": "npx",
"args": [
"-y",
"@granitebps/video-understanding-mcp"
],
"env": {
"VIDEO_BASE_URL": "your-value",
"VIDEO_MODEL": "your-value",
"VIDEO_API_KEY": "your-value",
"VIDEO_EXTRA_HEADERS": "your-value"
}
}
}
}VS Code (mcp.json)
{
"servers": {
"video-understanding": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@granitebps/video-understanding-mcp"
],
"env": {
"VIDEO_BASE_URL": "your-value",
"VIDEO_MODEL": "your-value",
"VIDEO_API_KEY": "your-value",
"VIDEO_EXTRA_HEADERS": "your-value"
}
}
}
}VIDEO_BASE_URL required envVIDEO_MODEL required envVIDEO_API_KEY secret required envVIDEO_EXTRA_HEADERS secret required envVIDEO_PART_FORMAT envVIDEO_MAX_DURATION_SECONDS envVIDEO_MAX_UPLOAD_MB envVIDEO_ALLOWED_DIRS envVIDEO_VERIFY_MEDIA envDescriptions are as written by the maker.
These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.
Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.
Run on your computer in
ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast
Runs on your computer; the tool list appears in your AI app after you install it.
We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 20, 2026
The registry name was verified with the GitHub account granitebps, which owns the repo
Code last changed 4 days ago
Uses MIT
This one runs on your computer; there is no internet endpoint
Runs on your computer and uses local settings instead
Runs on your computer; we can only read tool lists from internet endpoints
No entries on OSV.dev for @granitebps/video-understanding-mcp@1.0.2
Checks only this package version, not every dependency · checked Nov 16, 2026
If you made this, paste this code into your README. The badge links back to this page.
[](https://mcp.popnx.com/en/servers/granitebps-video-understanding-mcp)Ask, share a tip or report that it does not work. Sorted by what people marked helpful.
No posts yet. Be the first to ask or share.
Posts here are written by users, not the PopNx team.
No reviews yet
Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.
It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.
You need to fill in: VIDEO_API_KEY, VIDEO_EXTRA_HEADERS
It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).
The GitHub repo last changed 4 days ago, and the latest version (1.0.2) reached the registry 7 days ago.
Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js on your computer.
In the same category: HyperFrames by HeyGen, Pascal 3D Editor, draw.io, Figma MCP Server, Remocn: Remotion MCP server
Same category, other makers, commands already checked. Official ones first, then by stars.
Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi
Official HyperFrames by HeyGen: the best AI video editor in chat. Captions, motion graphics, MP4.
Create, inspect, validate, and save editable 3D building scenes with Pascal's MCP server.
Create draw.io diagrams in chat from Mermaid or XML, shown live and interactive. 10,000+ shapes.
Figma’s official server gives AI your design data so it can turn designs into code or describe them accurately. Connects to Figma’s cloud.
Hosted MCP for Remotion videos: search Remocn components, read docs, plan a video, preview it.
| This one Video Understanding MCP | HyperFrames by HeyGen | Pascal 3D Editor | draw.io | Figma MCP Server | Remocn: Remotion MCP server | |
|---|---|---|---|---|---|---|
| Runs where | Installs on your computer | Runs in the cloud, nothing to install | Cloud or install on your computer | Runs in the cloud, nothing to install | Runs in the cloud, nothing to install | Runs in the cloud, nothing to install |
| Needs a key | Yes | No | No | No | No | No |
| Add with + in Claude | No | Yes | No | No | Yes | No |
| Basic checks | 3/3 | 4/4 | 5/5 | 4/4 | 4/4 | 4/4 |
| License | MIT | Apache-2.0 | MIT | Apache-2.0 | – | MIT |
| Price | No cost listed in the registry | No cost listed in the registry | No cost listed in the registry | No cost listed in the registry | No cost listed in the registry | No cost listed in the registry |
Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.
An MCP server that lets AI agents watch a video and answer questions about it: what is shown, what is said, what text appears on screen, and when. It works with any OpenAI-compatible chat completions endpoint whose model accepts video, such as Gemini models served through a gateway.
Give it a TikTok, YouTube, or X post URL, a direct media URL from a scraper, or a local file, plus a question. It downloads and shrinks the video, sends it to your endpoint, and returns a structured answer:
{
"answer": "The coach demonstrates three squat variations and warns against letting the knees cave in.", "summary": "A short workout tutorial showing bodyweight squats with form cues.", "speech": { "present": true, "language": "en", "transcript": "Keep your chest up and push through your heels..." }, "on_screen_text": ["3 x 12 reps", "Rest 60s"], "timeline": [{ "start": 12.0, "description": "Switches to jump squats" }], "analysis": { "configuredModel": "your-model", "reportedModel": "gemini-...", "usage": { "promptTokens": 5400, "completionTokens": 480 }, "sourceDurationSeconds": 58.4, "analyzedRange": { "start": 0, "end": 58.4 }, "partFormat": "image_url", "warnings": [] } }
brew install ffmpeg. Debian/Ubuntu: sudo apt-get install ffmpeg. Windows: winget install ffmpeg.brew install yt-dlp. Others: pipx install yt-dlp.Check what the server found with the get_server_info tool.
Add the server to your MCP client. For example, in a JSON-configured client:
{
"mcpServers": { "video-understanding": { "command": "npx", "args": ["-y", "@granitebps/video-understanding-mcp"], "env": { "VIDEO_BASE_URL": "https://your-endpoint.example/v1", "VIDEO_MODEL": "your-video-capable-model", "VIDEO_API_KEY": "your-endpoint-api-key" } } } }
The server also reads a .env file from its working directory. See .env.example.
understand_video| Input | Description |
|---|---|
source | Required. A page URL (resolved with yt-dlp), a direct media URL, or an absolute local path inside an allowed directory. |
headers | Optional request headers for a direct media URL, such as Referer or Cookie returned by a scraper. Sent only to that URL's host. |
question | Optional. What to find out. Without it you get a general description. |
start_seconds, end_seconds | Optional range of the source video to analyze. Needed for videos longer than the duration limit; a short range also gives more detail for fast motion such as workouts. |
fps | Optional frame-sampling hint, applied only by request formats that support it. |
The result fields are shown above. timeline times are seconds from the start of the source video, even when a range was analyzed. analysis.warnings explains anything the server adjusted or could not confirm.
get_server_infoShows the version, endpoint host and model, request format, limits, local-file policy, and whether ffmpeg, ffprobe, and yt-dlp are available. It never shows the API key.
OpenAI-compatible endpoints disagree on how a video is attached to a chat request, and some silently ignore a format they do not understand. Pick the format your endpoint documents with VIDEO_PART_FORMAT:
VIDEO_PART_FORMAT | Request part | Known to be used by |
|---|---|---|
video_url | {"type":"video_url","video_url":{"url":"data:video/mp4;base64,..."}} | OpenRouter, Alibaba Model Studio (Qwen), Tencent TokenHub, vLLM |
image_url (default) | {"type":"image_url","image_url":{"url":"data:video/mp4;base64,..."}} | OpenRouter; routers that translate image parts by the data URL's MIME type, for example 9router's Gemini path |
file | {"type":"file","file":{"file_data":"data:video/mp4;base64,...","format":"video/mp4"}} | LiteLLM (Gemini, vLLM) |
input_file | {"type":"input_file","file_data":"data:video/mp4;base64,...","mime_type":"video/mp4"} | Requesty |
fps is sent only with video_url and file.
If the endpoint ignores the video, the call fails with MEDIA_NOT_PROCESSED instead of returning an answer the model made up. The server detects this by sending the same prompt without the video in parallel (16 output tokens at most) and comparing prompt-token usage, which cancels out any fixed overhead the endpoint adds. This doubles the request count. Turn it off with VIDEO_VERIFY_MEDIA=false only for endpoints that report token usage unusually.
| Variable | Default | Description |
|---|---|---|
VIDEO_BASE_URL | — | Required. Endpoint base URL, for example https://host/v1. |
VIDEO_MODEL | — | Required. Model name or router alias. |
VIDEO_API_KEY | — | Sent as Authorization: Bearer . |
VIDEO_EXTRA_HEADERS | — | Extra endpoint request headers as a JSON object, for example Cloudflare Access service-token headers. |
VIDEO_PART_FORMAT | image_url | image_url, video_url, file, or input_file. |
VIDEO_MAX_DURATION_SECONDS | 300 | Longest analyzed range (1–7200). |
VIDEO_MAX_UPLOAD_MB | 15 | Largest prepared video sent inline, before base64 (1–100). |
VIDEO_MAX_DOWNLOAD_MB | 500 | Largest source download (1–10000). |
VIDEO_REQUEST_TIMEOUT_MS | 180000 | Endpoint request timeout (5000–900000). |
VIDEO_MAX_CONCURRENCY | 2 | Analyses running at once; further calls wait (1–16). |
VIDEO_MAX_OUTPUT_TOKENS | 8192 | max_tokens for the answer (256–65536). |
VIDEO_VERIFY_MEDIA | true | Fail calls when the endpoint evidently ignored the video. |
VIDEO_ALLOWED_DIRS | — | Directories local files may be read from, separated by : (; on Windows). Local files are refused when unset. |
VIDEO_ALLOW_PRIVATE_NETWORK | false | Allow downloads from loopback and private addresses. |
VIDEO_FFMPEG_PATH | ffmpeg | ffmpeg executable. |
VIDEO_FFPROBE_PATH | ffprobe | ffprobe executable. |
VIDEO_YTDLP_PATH | yt-dlp | yt-dlp executable. |
Invalid values stop the server at startup with a message naming the variable. When VIDEO_BASE_URL or VIDEO_MODEL is missing the server still starts, and understand_video returns CONFIG_MISSING.
ENDPOINT_UNREACHABLE before anything is downloaded.Temporary files are deleted after every call, including failed and cancelled ones.
Errors start with a code in brackets, for example [LIMIT_EXCEEDED] The analyzed range is 1500 s, over the 300 s limit ..., and carry the same code in _meta["video-understanding-mcp/error"].
| Code | Meaning |
|---|---|
INVALID_INPUT | Bad range or source string. |
CONFIG_MISSING | VIDEO_BASE_URL or VIDEO_MODEL is not set. |
DEPENDENCY_MISSING | ffmpeg/ffprobe, or yt-dlp for a page URL, is not installed. |
SOURCE_UNAVAILABLE | The page or media URL could not be fetched or extracted (expired link, unsupported site). |
SOURCE_NOT_ALLOWED | Local file outside the allowed directories, or a download target on a private network. |
INVALID_MEDIA | The source has no video stream. |
LIMIT_EXCEEDED | Over the duration, upload, or download limit, or rejected as too large by the endpoint. |
ENDPOINT_UNREACHABLE | The configured base URL is not reachable. |
ENDPOINT_AUTH | The endpoint rejected the API key. |
| `ENDPOINT_RATE