Web Search API Eval

Name: Web Search API Eval
Author: psinglap

by psinglapversion 1.1.0i★ –iComputer or cloud

Registry nameio.github.psinglap/websearch-api-eval

Install

Overview

Description from the maker (original English)

Web search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

User voiceiNo reviews yetReviews open together with accounts in a later step
Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
UsageiNot measured yet★ –

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Computer or cloud
Transport: stdio, Streamable HTTP
Category: Search & AI memory
You need to fill in: YDC_API_KEY, TAVILY_API_KEY, EXA_API_KEY, PARALLEL_API_KEY

Install

Pick the AI app you use, then copy the settings.

Before you install

Basic checks: 1 of 1 passed
Runs on the maker’s server: what you ask it goes through their server.
You fill in yourself: YDC_API_KEY, TAVILY_API_KEY, EXA_API_KEY, PARALLEL_API_KEY

Values marked secret are keys to your account. Never share them or paste them into a chat.

You need

Runs in the cloudNothing to install; it connects over the internet
npmNode.js installed (for the npx command)

Which app do you use?

ClaudeClaude CodeCursorVS CodeChatGPT

Pick your app above. We remember it, so next time the button says “Install in …”.

Works in Claude on the web, desktop and mobile:

Open Settings → Connectors
Press Add custom connector
Paste the address below and press Add
If it asks you to sign in, sign in with the maker

https://websearch-api-eval.psberkeleymba.workers.dev/mcp

Or run it on your computer

Open Claude Desktop → Settings → Developer → Edit Config, and paste this into claude_desktop_config.json

{
  "mcpServers": {
    "websearch-api-eval": {
      "command": "npx",
      "args": [
        "-y",
        "websearch-api-eval-mcp"
      ],
      "env": {
        "YDC_API_KEY": "your-value",
        "TAVILY_API_KEY": "your-value",
        "EXA_API_KEY": "your-value",
        "PARALLEL_API_KEY": "your-value"
      }
    }
  }
}

Run this in your terminal

claude mcp add --transport http websearch-api-eval https://websearch-api-eval.psberkeleymba.workers.dev/mcp

Or run it on your computer

claude mcp add websearch-api-eval --env YDC_API_KEY=your-value --env TAVILY_API_KEY=your-value --env EXA_API_KEY=your-value --env PARALLEL_API_KEY=your-value -- npx -y websearch-api-eval-mcp

Fill in the empty values before running it.

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "websearch-api-eval": {
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}

Or run it on your computer

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "websearch-api-eval": {
      "command": "npx",
      "args": [
        "-y",
        "websearch-api-eval-mcp"
      ],
      "env": {
        "YDC_API_KEY": "your-value",
        "TAVILY_API_KEY": "your-value",
        "EXA_API_KEY": "your-value",
        "PARALLEL_API_KEY": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "websearch-api-eval": {
      "type": "http",
      "url": "https://websearch-api-eval.psberkeleymba.workers.dev/mcp"
    }
  }
}

Or run it on your computer

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "websearch-api-eval": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "websearch-api-eval-mcp"
      ],
      "env": {
        "YDC_API_KEY": "your-value",
        "TAVILY_API_KEY": "your-value",
        "EXA_API_KEY": "your-value",
        "PARALLEL_API_KEY": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

ChatGPT connects only to servers on the internet:

Open ChatGPT on the web → Settings → Connectors (Apps)
Press Create or Add (some plans need Developer mode under Advanced first)
Paste the address below, give it a name and save
If it asks you to sign in, sign in with the maker

https://websearch-api-eval.psberkeleymba.workers.dev/mcp

Menu names can differ slightly by plan and over time.

Your choice stays on this device in a cookie; no account needed.

Values you fill in

YDC_API_KEY secret env
Optional. You.com API key, used only by run_live_search
TAVILY_API_KEY secret env
Optional. Tavily API key, used only by run_live_search
EXA_API_KEY secret env
Optional. Exa API key, used only by run_live_search
PARALLEL_API_KEY secret env
Optional. Parallel API key, used only by run_live_search

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

What it can do

We have not read this server’s tool list yet; we check endpoints in rotation.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 6, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account psinglap, which owns the repo
… Not checked yet
Still maintained
We have not read this repo from GitHub yet
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
… Not checked yet
Endpoint responds
Not checked yet; we check endpoints in rotation
… Not checked yet
Sign-in with OAuth
Not checked yet; we check endpoints in rotation
… Not checked yet
No hidden instructions in tool descriptions
Not checked yet; we read the tool list when we check the endpoint

Compared with others in Search & AI memoryi

More stars than 0% of the other 7231 servers in this category
Published to the registry more recently than 77% of the other 7231 servers in this category
Basic checks equal to or better than 100% of the other 7231 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Web Search API Eval safe?

It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: YDC_API_KEY, TAVILY_API_KEY, EXA_API_KEY, PARALLEL_API_KEY

Does it run on my computer or in the cloud?

Either way works: install it on your computer or connect to the cloud version.

Is it still maintained?

The GitHub repo last changed –, and the latest version (1.1.0) reached the registry 10 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT in developer mode.

What can I use instead?

In the same category: Context7, Codebase Memory, Exa

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Context7

by upstash

Feeds AI the latest docs for libraries and frameworks before it answers, so code it writes does not use outdated, removed functions.

Computer or cloud★ 64,224MITUpdated 3 days ago

Install

Codebase Memory

by DeusData

Codebase knowledge graph for AI agents — 162 languages, sub-ms queries, 99% fewer tokens.

Runs on your computer★ 48,148MITUpdated 20 days ago

Install

Exa

by exa-labs

Connect AI agents to Exa for web search, content fetching, and multi-step research.

Runs in the cloud★ 5,213MITUpdated 44 days ago

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

Web Search API Eval: MCP server

An MCP server that lets Claude, ChatGPT, Cursor and other AI assistants answer questions about the Web Search API Eval benchmark (You.com, Tavily, Exa and Parallel on 30 agent queries), and run your own live search spot checks.

Use it two ways:

	Hosted (no install)	Local (npm)
Connect	`https://websearch-api-eval.psberkeleymba.workers.dev/mcp`	`npx -y websearch-api-eval-mcp`
Works in	Claude, ChatGPT, any remote MCP client	Claude Desktop, Claude Code, Cursor, VS Code, any stdio MCP client
Benchmark tools	✅	✅
`run_live_search` with your own keys	—	✅

Install

Claude Code

claude mcp add websearch-api-eval -- npx -y websearch-api-eval-mcp

Claude Desktop, Cursor, VS Code (add to the client's MCP config):

"mcpServers": { "websearch-api-eval": { "command": "npx", "args": ["-y", "websearch-api-eval-mcp"], "env": { "YDC_API_KEY": "optional", "TAVILY_API_KEY": "optional", "EXA_API_KEY": "optional", "PARALLEL_API_KEY": "optional" } } } }

The keys are optional and only used by run_live_search. Leave out any provider you don't have a key for. Requires Node.js 18 or later.

Hosted, no install: in Claude, Settings → Connectors → Add custom connector → paste the hosted URL. In ChatGPT, create an app in Developer mode with the same URL and no authentication.

Tools

Tool	Returns
`get_overall_results`	Headline, overall scorecard, per-use-case summary, which API fits which agent, developer activation
`get_scorecard`	Full scorecard for `overall`, `gtm`, `insurance` or `finance`
`compare_providers`	Two or more providers side by side, optionally filtered by metric keyword
`recommend_provider`	Which API fits an agent's need, with supporting numbers
`list_questions`	The 30 questions, filterable by use case
`get_question`	One question: task, search call, answer key, sources, what each API returned and its score
`get_charts`	The published graphs; with `chart_id`, also the image
`get_methodology`	How tests ran and were graded, the 10 metrics and their standards, limits
`how_to_run_locally`	Steps and keys to rerun the full benchmark on your own machine
`search`, `fetch`	Generic search and document fetch (used by ChatGPT research features)
`run_live_search` (local only)	Sends one query to each provider using your own API keys and returns latency, result count and top results

The benchmark tools are read-only and read the published results (run Oct 8, 2026). run_live_search calls the providers directly from your machine with your keys and uses your own credits; a single call is a spot check, not a graded benchmark. For the full graded run, use the harness.

Example questions

"Which web search API is fastest for a voice agent?"
"Compare Exa and Parallel on finance."
"What was question F5 and who got it right?"
"Show me the overall scorecard chart."
"Run a live search for 'FOMC minutes' and compare the providers."

Data and updates

Results come from data/*.json on the published site, built from the Evaluation page by data/build_data.py. After a new benchmark run, rebuild the data and push; both the hosted and npm servers pick it up with no redeploy or new release.

Develop

cd mcp

npm install npx wrangler dev # hosted server locally at http://localhost:8787/mcp npm run build # npm package entry at dist/cli.js npx @modelcontextprotocol/inspector@0.17.2 node dist/cli.js # call tools by hand npx wrangler deploy # deploy the hosted server npm publish # publish the npm package

Built with the official MCP TypeScript SDK. Registry entry: io.github.psinglap/websearch-api-eval (server.json).

Privacy and support

No sign-in, no cookies, no storage, no request logging. Privacy Policy · Terms · Support · MIT License

Web Search API Eval

Overview

PopNx MCP’s three pillars

What you can do with it

Install

Before you install

Or run it on your computer

Or run it on your computer

Or run it on your computer

Or run it on your computer

Values you fill in

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Compared with others in Search & AI memoryi

Common questions

Alternatives

Context7

Codebase Memory

Exa

README from the maker

Web Search API Eval: MCP server

Install

Tools

Example questions

Data and updates

Develop

Privacy and support