Tokenectomy Razor

Tokenectomy Razor

Fix Claude Code & Cursor Rate Limits: Zero-Latency Local AI Gateway & Context-Surgery MCP Server in Rust Stop burning 20,000 tokens on node_modules stack traces. Tokenectomy Razor is a sub-millisecond local AI Gateway reverse proxy (127.0.0.1:8080) & companion MCP server written in safe Rust. Excises 41.7%–99.7% framework noise from terminal error logs, redacts leaked DB credentials/JWTs, and caches prompts for free.

Quick Start (10s) • Architecture • The Problem • Before & After • Live Interactive Demo • Benchmarks

                                 ┌────────────────────────────────────────────────────────┐

│ Autonomous Agents │ │ Claude Code • Cursor • Antigravity • Cline • Windsurf │ └───────────────────────────┬────────────────────────────┘ │ ▼ (HTTP / SSE Outbound Prompts) ┌──────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐ │ ⚡ TOKENECTOMY AI GATEWAY (127.0.0.1:8080) │ │ │ │ ┌─────────────────────────┐ ┌───────────────────────────┐ ┌──────────────────────────────────────────────┐ │ │ │ Zero-Cost Prompt │ │ Zero-Leak Credential │ │ Polyglot Trace Surgery │ │ │ │ Cache │ │ Redaction │ │ (9 Languages) │ │ │ │ <1ms Hit • 100% Free │ │ API Keys • JWTs • DB URIs│ │ node_modules • site-packages • .cargo │ │ │ └───────────┬─────────────┘ └─────────────┬─────────────┘ └──────────────────────┬───────────────────────┘ │ │ │ │ │ │ │ └───────────────────────────────┼────────────────────────────────────────┘ │ │ ▼ │ │ Smart Upstream Auto-Router │ │ (Anthropic • OpenAI • Groq • Ollama Local) │ └──────────────────────────────────────────────┬───────────────────────────────────────────────────────────────────┘ │ ┌────────────────────────────────┼────────────────────────────────┐ ▼ ▼ ▼ api.anthropic.com api.openai.com localhost:11434 (Claude 3.5 / 3.7 Sonnet) (GPT-4o / o1 / o3-mini) (DeepSeek / Llama)

---

⚡ Quick Start (10s)

0. Zero-Config One-Liner Wrapper (wrap)

Run any coding agent or test suite directly behind Tokenectomy's privacy & caching gateway with zero manual environment variable setup:

# Wrap Claude Code CLI

razor wrap -- claude

Wrap Aider with DeepSeek or Ollama (Auto-Transpiled on the fly!)

razor wrap -- aider --model deepseek/deepseek-chat

Wrap test runs to scrub logs and prevent accidental credential leakage

razor wrap npm test

1. Launch the Standalone AI Gateway (Manual Mode)

npx -y tokenectomy-razor --proxy

💡 Smart Multi-Provider Auto-Routing & Universal LLM Transpiler ON by default! Tokenectomy automatically analyzes request paths and headers. Need to run Claude Code against DeepSeek or Ollama? Tokenectomy transparently transpiles Anthropic /v1/messages format into OpenAI /v1/chat/completions on-the-fly and vice-versa.

2. Connect Your Favorite Agent

Point your coding agent or CLI to the local gateway on 127.0.0.1:8080:

3. Real-Time FinOps & Security Dashboard

Open `http://127.0.0.1:8080/dashboard` in your browser to observe live token reductions, prompt cache hits, dollar savings, and redacted credentials in real time.

---

4. Companion MCP Server Setup (Sub-Cortex)

For agents calling deep diagnostic tools (get_error_context, analyze_code, apply_code_patch):

Claude Code CLI

claude mcp add tokenectomy npx -y tokenectomy-razor --mcp

Google Antigravity / Gemini CLI

agy mcp add tokenectomy-razor -- npx -y tokenectomy-razor --mcp

Cursor Composer (.cursor/mcp.json)

{

"mcpServers": { "tokenectomy": { "command": "npx", "args": ["-y", "tokenectomy-razor", "--mcp"] } } }

Claude Desktop (claude_desktop_config.json)

{

"mcpServers": { "tokenectomy": { "command": "npx", "args": ["-y", "tokenectomy-razor", "--mcp"] } } }

5. Terminal Piping & CLI Scrubbing

npm test 2>&1 | npx tokenectomy-razor

---

🛑 The Problem: Why Your AI Hits Rate Limits & Hallucinates

When your app crashes during development (Next.js, Express, FastAPI, Tokio), the runtime dumps hundreds of lines of third-party plumbing from node_modules or site-packages.

When you paste that raw crash dump into Cursor or Claude:

1. Eats Your 5-Hour Rate Limit: A single Express/Prisma error can dump 5,000 to 45,000 tokens of third-party library code you never wrote. A few crash loops easily burn your session limit.
2. Triggers AI Hallucinations: Claude gets lost in framework internals (node_modules/express/lib/router/layer.js or starlette/routing.py) and tries to edit library files instead of your actual application code.
3. Leaks Secrets & Credentials: Connection strings with raw database passwords, JWT bearer tokens, and cloud keys embedded in error traces get forwarded to external model servers.

Raw Terminal Crash (45,820 tokens + Leaked Secrets)

│ ▼ <0.2ms Local Rust DFA Engine [Redact Passwords & Keys] ──► [Strip Third-Party Framework Frames] ──► [Isolate Root Cause] │ ▼ Clean Context (118 tokens • Zero Secrets • Sub-millisecond)

---

🔍 Before & After Comparison

❌ Without Tokenectomy: AI Hallucinates & Burns Context

TypeError: Cannot read properties of undefined (reading 'token')

at loadComponents (/app/node_modules/next/dist/server/load-components.js:14:2) at renderToHTML (/app/node_modules/next/dist/server/render.js:50:5) at nextServer (/app/node_modules/next/dist/server/next-server.js:80:12) at processTicksAndRejections (node:internal/process/task_queues:95:5) at runMicrotasks (node:internal/process/task_queues:120:3) at checkoutHandler (/app/pages/api/checkout.ts:42:15) Database connection failed: postgresql://admin:super_secret_password@db.prod.internal:5432/primary API key leaked: [PopNx MCP ตัดค่าที่หน้าตาเหมือนกุญแจออก]

> **What Claude does:** Analyzes `load-components.js` and `next-server.js`, speculates on Webpack / Next.js internals, and leaks connection credentials to remote inference logs.

✅ With Tokenectomy: Clean Context & Instant Fix

// [Tokenectomy Surgery: 5 internal framework frames pruned (83.3%)]

// Source: /app/pages/api/checkout.ts:42:15 42 | const sessionToken = req.headers.authorization.token; | ^ TypeError: Cannot read properties of undefined (reading 'token') 🛡️ [CONNECTION_STRING_REDACTED] 🛡️ [ANTHROPIC_KEY_REDACTED]

> **What Claude does:** Instantly identifies that line 42 in `checkout.ts` attempted to access `.token` on undefined headers. Suggests optional chaining `req.headers.authorization?.token` immediately. Credentials redacted before transmission.

---

🔬 Verifiable Benchmarks

All performance claims are hardware-grounded and independently reproducible on physical hardware (measured on 10-Core Intel Core i5-1235U @ 15W running Arch Linux, Kernel 6.13):

Hardware Dependency Notice: Performance is hardware-dependent; reported throughput represents measured results on the specified test hardware (10-Core Intel Core i5-1235U @ 15W TDP). Throughput scales with higher TDP desktop/server CPUs and faster memory buses. Developers are encouraged to independently audit performance using the reproduction command below.

📋 Click to expand full raw benchmark terminal log ($ cargo test --release)

$ cargo test --release --test stress_benchmark -- --nocapture

===================================================================================== 🧪 TOKENECTOMY OSS VERIFIABLE HEAVY STRESS BENCHMARK (100% REPRODUCIBLE IN OSS) Hardware: 10-Core / 12-Thread Intel Core i5-1235U | OS: Arch Linux | Kernel Telemetry Active Initial Baseline Process Memory (VmRSS): 3.45 MB =====================================================================================

🔥 [TEST 1/3] QUARTER-MILLION LINES LOG REDACTION TORTURE (250,0