Webcrawl Anything

Name: Webcrawl Anything
Author: brainfish-ai

by brainfish-aiversion 1.4.2i★ –iComputer or cloud

Registry nameio.github.brainfish-ai/webcrawl

Install

Overview

Description from the maker (original English)

Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

User voiceiNo reviews yetReviews open together with accounts in a later step
Our basic checksi3 of 3 passedChecked from public information; code not scanned yet
UsageiNot measured yet★ –

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Computer or cloud
Transport: stdio, Streamable HTTP
Category: Web & browsers
You need to fill in: WEBCRAWL_API_KEY

Install

Pick the AI app you use, then copy the settings.

Before you install

Basic checks: 3 of 3 passed
Runs on the maker’s server: what you ask it goes through their server.
You fill in yourself: WEBCRAWL_API_KEY, WEBCRAWL_MODE, WEBCRAWL_MCP_SCHEMA_PROFILE

Values marked secret are keys to your account. Never share them or paste them into a chat.

You need

Runs in the cloudNothing to install; it connects over the internet
npmNode.js installed (for the npx command)

Which app do you use?

ClaudeClaude CodeCursorVS CodeChatGPT

Pick your app above. We remember it, so next time the button says “Install in …”.

Works in Claude on the web, desktop and mobile:

Open Settings → Connectors
Press Add custom connector
Paste the address below and press Add
If it asks you to sign in, sign in with the maker

https://webcrawl.app/mcp

Or run it on your computer

Open Claude Desktop → Settings → Developer → Edit Config, and paste this into claude_desktop_config.json

{
  "mcpServers": {
    "webcrawl": {
      "command": "npx",
      "args": [
        "-y",
        "@webcrawl/mcp"
      ],
      "env": {
        "WEBCRAWL_API_KEY": "your-value",
        "WEBCRAWL_MODE": "your-value",
        "WEBCRAWL_MCP_SCHEMA_PROFILE": "your-value"
      }
    }
  }
}

Run this in your terminal

claude mcp add --transport http webcrawl https://webcrawl.app/mcp

Or run it on your computer

claude mcp add webcrawl --env WEBCRAWL_API_KEY=your-value --env WEBCRAWL_MODE=your-value --env WEBCRAWL_MCP_SCHEMA_PROFILE=your-value -- npx -y @webcrawl/mcp

Fill in the empty values before running it.

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "webcrawl": {
      "url": "https://webcrawl.app/mcp"
    }
  }
}

Or run it on your computer

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "webcrawl": {
      "command": "npx",
      "args": [
        "-y",
        "@webcrawl/mcp"
      ],
      "env": {
        "WEBCRAWL_API_KEY": "your-value",
        "WEBCRAWL_MODE": "your-value",
        "WEBCRAWL_MCP_SCHEMA_PROFILE": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "webcrawl": {
      "type": "http",
      "url": "https://webcrawl.app/mcp"
    }
  }
}

Or run it on your computer

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "webcrawl": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@webcrawl/mcp"
      ],
      "env": {
        "WEBCRAWL_API_KEY": "your-value",
        "WEBCRAWL_MODE": "your-value",
        "WEBCRAWL_MCP_SCHEMA_PROFILE": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

ChatGPT connects only to servers on the internet:

Open ChatGPT on the web → Settings → Connectors (Apps)
Press Create or Add (some plans need Developer mode under Advanced first)
Paste the address below, give it a name and save
If it asks you to sign in, sign in with the maker

https://webcrawl.app/mcp

Menu names can differ slightly by plan and over time.

Your choice stays on this device in a cookie; no account needed.

Values you fill in

WEBCRAWL_API_KEY secret env
Optional. Leave unset to run fully local. Set a webcrawl.app key to use the hosted cloud.
WEBCRAWL_MODE env
Optional: local, cloud or auto. Default auto runs local unless an API key is set.
WEBCRAWL_MCP_SCHEMA_PROFILE env
Set to compact for smaller tool schemas in context-limited clients.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

What it can do

The server asks you to sign in before it lists its tools.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 6, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account brainfish-ai, which owns the repo
… Not checked yet
Still maintained
We have not read this repo from GitHub yet
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
✓ Pass
Endpoint responds
Responded in 372 ms (HTTP 401)
✓ Pass
Sign-in with OAuth
Declares OAuth sign-in, so your AI app can take you to log in
… Not checked yet
No hidden instructions in tool descriptions
Not checked yet; we read the tool list when we check the endpoint

Compared with others in Web & browsersi

More stars than 0% of the other 878 servers in this category
Published to the registry more recently than 92% of the other 878 servers in this category
Basic checks equal to or better than 100% of the other 878 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Webcrawl Anything safe?

It passed 3 of 3 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: WEBCRAWL_API_KEY

Does it run on my computer or in the cloud?

Either way works: install it on your computer or connect to the cloud version.

Is it still maintained?

The GitHub repo last changed –, and the latest version (1.4.2) reached the registry 2 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT in developer mode.

What can I use instead?

In the same category: Browser Use, Chrome DevTools MCP, MCP Server Browser

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Browser Use

by browser-use

Lets AI do web tasks for you, such as filling forms, searching and extracting data, in the maker’s cloud browsers or on your computer.

Computer or cloud★ 120,087MITUpdated 17 days ago

Install

Chrome DevTools MCP

by ChromeDevTools

Lets AI use Chrome’s developer tools to inspect pages, find what makes them slow and spot errors. Made by the Chrome DevTools team.

Runs on your computer★ 54,821Apache-2.0Updated 15 days ago

Install

MCP Server Browser

by bytedance

MCP server for browser use access

Runs on your computer★ 39,550Apache-2.0Updated 14 months ago

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

@webcrawl/mcp

Model Context Protocol (MCP) server for [Webcrawl Anything](https://github.com/brainfish-ai/webcrawl-anything).

Gives Claude Code, Cursor, Codex, Windsurf, and Gemini CLI live access to web search, structured verticals (shopping, flights, hotels, real-estate, local business, CVEs), page reading for JavaScript-heavy sites, and PDF/Office parsing. It runs on your machine with no API key and no account.

One-Command Agent Setup

npx webcrawl setup

Manual MCP Configuration

Add to .cursor/mcp.json, ~/.claude.json, or your MCP client config:

"mcpServers": { "webcrawl": { "command": "npx", "args": ["-y", "@webcrawl/mcp@latest"], "env": { "WEBCRAWL_MCP_SCHEMA_PROFILE": "compact" } } } }

Optional: webcrawl.app cloud

Local mode is the default and needs nothing else. To run the same tools on the hosted service, either:

add "WEBCRAWL_API_KEY": "wc_live_..." to env above (get a key at webcrawl.app), or
connect your client to the hosted endpoint https://webcrawl.app/mcp and sign in in the browser. No local install is needed.

WEBCRAWL_MODE can be local, cloud or auto (default: local unless a key is set).

Compact Schema Profile

Set WEBCRAWL_MCP_SCHEMA_PROFILE=compact (default when installed via npx webcrawl setup) to minimize tool schema token usage in context-constrained agents while keeping full server-side validation. Set WEBCRAWL_MCP_SCHEMA_PROFILE=full for verbose parameter descriptions.

Tools Provided

web_search — Search the web or structured verticals (shopping, flights, hotels, real-estate, business, security, academic, tech, news).
web_read — Fetch a URL and return clean Markdown with target evidence.
web_parse / web_parse_status — Parse PDFs (native + OCR), Word/Excel/PowerPoint files, YouTube videos, and audio/video into Markdown.
web_map — Discover all URLs on a domain (sitemap.xml, robots.txt, and link graph).
web_crawl — Crawl up to 25 pages starting from a URL.
web_extract — Extract structured JSON from a URL using a prompt or JSON Schema.
web_rerank — Rerank candidate documents by relevance to a query.
web_monitor — Watch a page, URL list or site on a schedule with trigger conditions and email/webhook alerts (cloud only).
search_categories — List all supported search categories, subcategories, and filters.

License

MIT

Webcrawl Anything

Overview

PopNx MCP’s three pillars

What you can do with it

Install

Before you install

Or run it on your computer

Or run it on your computer

Or run it on your computer

Or run it on your computer

Values you fill in

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Compared with others in Web & browsersi

Common questions

Alternatives

Browser Use

Chrome DevTools MCP

MCP Server Browser

README from the maker

@webcrawl/mcp

One-Command Agent Setup

Manual MCP Configuration

Optional: webcrawl.app cloud

Compact Schema Profile

Tools Provided

License