Web Search API Eval

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

• Connection: Computer or cloud
• Transport: stdio, Streamable HTTP
• Category: Search & AI memory
• You need to fill in: YDC_API_KEY, TAVILY_API_KEY, EXA_API_KEY, PARALLEL_API_KEY

Install

Pick the AI app you use, then copy the settings.

Passed 4/4 checks · What you ask goes through the maker’s server (websearch-api-eval.psberkeleymba.workers.dev)

claude mcp add --transport http websearch-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcp

{
  "mcpServers": {
    "websearch-api-eval": {
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}

{
  "servers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}

claude mcp add websearch-api-eval --env YDC_API_KEY=your-value --env TAVILY_API_KEY=your-value --env EXA_API_KEY=your-value --env PARALLEL_API_KEY=your-value -- npx -y websearch-api-eval-mcp

{
  "mcpServers": {
    "websearch-api-eval": {
      "command": "npx",
      "args": [
        "-y",
        "websearch-api-eval-mcp"
      ],
      "env": {
        "YDC_API_KEY": "your-value",
        "TAVILY_API_KEY": "your-value",
        "EXA_API_KEY": "your-value",
        "PARALLEL_API_KEY": "your-value"
      }
    }
  }
}

{
  "mcpServers": {
    "websearch-api-eval": {
      "command": "npx",
      "args": [
        "-y",
        "websearch-api-eval-mcp"
      ],
      "env": {
        "YDC_API_KEY": "your-value",
        "TAVILY_API_KEY": "your-value",
        "EXA_API_KEY": "your-value",
        "PARALLEL_API_KEY": "your-value"
      }
    }
  }
}

{
  "servers": {
    "websearch-api-eval": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "websearch-api-eval-mcp"
      ],
      "env": {
        "YDC_API_KEY": "your-value",
        "TAVILY_API_KEY": "your-value",
        "EXA_API_KEY": "your-value",
        "PARALLEL_API_KEY": "your-value"
      }
    }
  }
}

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Connect over the internet in

ClaudeChatGPTGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatOpen WebUIRaycast

Run on your computer in

ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast

All apps, with pros and cons →

What it can do

Tool names and descriptions exactly as the server reported them on Nov 11, 2026. The maker wrote them, not us; we show them as plain text.

• get_overall_results

  Headline findings and the overall scorecard across all 30 queries (90 calls per API): accuracy, fully correct, precision@5, freshness, empty responses, failed calls, latency p50/p95, cost per correct answer. Also the per-use-case summary, which API fits which agent, and developer

• get_scorecard

  Full metric scorecard for one use case (gtm, insurance, finance) or 'overall'. Metrics: search-only latency p50/p95 (server and client), calls under 1 s, accuracy, freshness (% in window, newest relevant result age), content in one call, tokens, search cost.

• compare_providers

  Compare two or more of You.com, Tavily, Exa and Parallel side by side, overall or within one use case, optionally filtered to metrics whose name contains a keyword (e.g. 'latency', 'accuracy', 'fresh', 'cost', 'empty').

• recommend_provider

  Which web search API fits an agent, based on this benchmark: live voice/chat turns, deep research, semantic or long-tail queries, docs lookups, or a specific use case (GTM, insurance, finance). Returns the guidance with the supporting numbers.

• list_questions

  The 30 benchmark questions (G1-G10 GTM, I1-I10 insurance, F1-F10 finance): ID, what the agent is asked, the search call and freshness.

• get_question

  One benchmark question by ID (e.g. G3, I4, F5): the task, search call, parameters, answer key with sources, and what each API returned with its accuracy score (0-2, mean of 3 runs).

• get_charts

  The published graphs: overall scorecard, key metrics and per-query grids for GTM, insurance and finance, and developer activation. Without chart_id, lists them with titles and image links; with chart_id, also returns the image.

• get_methodology

  How the benchmark was run and graded: query design, identical request parameters, 3 runs per query, latency timing, SimpleQA and FreshQA grading, the 10 metrics and the standards they follow, and limits.

• how_to_run_locally

  How to rerun this benchmark on your own machine with your own API keys, including on your own queries. Nothing runs on this server.

• search

  Search the Web Search API Eval benchmark (results, questions, methodology, charts, how to run). Returns matching document IDs, titles and URLs.

• fetch

  Full text of one benchmark document by its ID (for example question-F5, scorecard-finance, overall, methodology).

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 12, 2026

• ✓ Pass

  Maker matches the repo

  The registry name was verified with the GitHub account psinglap, which owns the repo

• ✓ Pass

  Still maintained

  Code last changed 15 days ago

• … Not checked yet

  Has a licence

  We have not read this repo from GitHub yet

• ✓ Pass

  Endpoint responds

  Responded in 164 ms (HTTP 200)

• – Not applicable

  Sign-in with OAuth

  No sign-in needed

• ✓ Pass

  No hidden instructions in tool descriptions

  Read 11 tool descriptions and found no hidden instructions to the AI

User reviews

No reviews yet

Sign in with Google to write a review

Compared with others in Search & AI memoryi

• More stars than 87% of the other 5958 servers in this category
• Published to the registry more recently than 70% of the other 5958 servers in this category
• Basic checks equal to or better than 100% of the other 5958 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Ruflo

Agent teams, swarms, memory and hooks for Claude Code and Codex, served over MCP.

by ruvnet·Widely used·↓ 74.3K/wk·★ 81.5K·Updated today

Runs on your computer

Install

Context7

Feeds AI the latest docs for libraries and frameworks before it answers, so code it writes does not use outdated, removed functions.

by upstash·Widely used·↓ 1.2M/wk·★ 64.6K·Updated 2 days ago

Computer or cloud

Install

Metabase

Lets AI clients search, explore, query, and visualize data in a Metabase instance.

by metabase·Widely used·★ 50.3K·Updated 6 months ago

Runs in the cloud

Install

README from the maker

claude mcp add websearch-api-eval -- npx -y websearch-api-eval-mcp

{

cd mcp