WebCrawlerAPI

Name: WebCrawlerAPI
Author: WebCrawlerAPI

by WebCrawlerAPIversion 0.1.3i★ –iRuns in the cloud

Registry namecom.webcrawlerapi/mcp-server

Install

Overview

Description from the maker (original English)

Turn any web page into clean Markdown for your AI assistant. OAuth sign-in, no API key.

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

User voiceiNo reviews yetReviews open together with accounts in a later step
Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
UsageiNot measured yet★ –

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs in the cloud
Transport: Streamable HTTP
Category: Web & browsers

Install

Pick the AI app you use, then copy the settings.

Before you install

Basic checks: 1 of 1 passed
Runs on the maker’s server: what you ask it goes through their server.
The registry lists no key to fill in.

You need

Runs in the cloudNothing to install; it connects over the internet

Which app do you use?

ClaudeClaude CodeCursorVS CodeChatGPT

Pick your app above. We remember it, so next time the button says “Install in …”.

Works in Claude on the web, desktop and mobile:

Open Settings → Connectors
Press Add custom connector
Paste the address below and press Add
If it asks you to sign in, sign in with the maker

https://mcp.webcrawlerapi.com/mcp

Run this in your terminal

claude mcp add --transport http webcrawlerapi https://mcp.webcrawlerapi.com/mcp

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "webcrawlerapi": {
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "webcrawlerapi": {
      "type": "http",
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

ChatGPT connects only to servers on the internet:

Open ChatGPT on the web → Settings → Connectors (Apps)
Press Create or Add (some plans need Developer mode under Advanced first)
Paste the address below, give it a name and save
If it asks you to sign in, sign in with the maker

https://mcp.webcrawlerapi.com/mcp

Menu names can differ slightly by plan and over time.

Your choice stays on this device in a cookie; no account needed.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

What it can do

We have not read this server’s tool list yet; we check endpoints in rotation.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 6, 2026

✓ Pass
Maker matches the repo
The registry name was verified against the domain webcrawlerapi.com (the registry checks domain ownership)
… Not checked yet
Still maintained
We have not read this repo from GitHub yet
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
… Not checked yet
Endpoint responds
Not checked yet; we check endpoints in rotation
… Not checked yet
Sign-in with OAuth
Not checked yet; we check endpoints in rotation
… Not checked yet
No hidden instructions in tool descriptions
Not checked yet; we read the tool list when we check the endpoint

Compared with others in Web & browsersi

More stars than 0% of the other 876 servers in this category
Published to the registry more recently than 86% of the other 876 servers in this category
Basic checks equal to or better than 100% of the other 876 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is WebCrawlerAPI safe?

It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.

Is it still maintained?

The GitHub repo last changed –, and the latest version (0.1.3) reached the registry 5 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT in developer mode.

What can I use instead?

In the same category: Browser Use, Chrome DevTools MCP, MCP Server Browser

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Browser Use

by browser-use

Lets AI do web tasks for you, such as filling forms, searching and extracting data, in the maker’s cloud browsers or on your computer.

Computer or cloud★ 120,087MITUpdated 16 days ago

Install

Chrome DevTools MCP

by ChromeDevTools

Lets AI use Chrome’s developer tools to inspect pages, find what makes them slow and spot errors. Made by the Chrome DevTools team.

Runs on your computer★ 54,821Apache-2.0Updated 15 days ago

Install

MCP Server Browser

by bytedance

MCP server for browser use access

Runs on your computer★ 39,550Apache-2.0Updated 14 months ago

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

WebCrawlerAPI MCP server

A remote Model Context Protocol server that lets AI assistants read any web page as clean Markdown. It runs on WebCrawlerAPI, so JavaScript-rendered pages work and navigation, ads and boilerplate are stripped. Use it to pull docs, articles and product pages into a knowledge base or into a chat.

Remote URL: https://mcp.webcrawlerapi.com/mcp
Transport: Streamable HTTP (stateless)
Sign-in: OAuth 2.1 through https://auth.webcrawlerapi.com, no API key to paste
Tool: get_markdown

You need a WebCrawlerAPI account. Sign up at https://dash.webcrawlerapi.com.

Connect

One-click install: Add to Cursor · Add to VS Code

In every client below, the first request opens a browser window where you sign in and approve access for one of your organizations. Requests are billed to that organization.

Claude Code

claude mcp add --transport http webcrawlerapi https://mcp.webcrawlerapi.com/mcp

Then run /mcp inside Claude Code, pick webcrawlerapi and choose Authenticate.

Claude.ai and Claude Desktop

Open Settings, then Connectors.
Choose Add custom connector.
Name: WebCrawlerAPI. URL: https://mcp.webcrawlerapi.com/mcp.
Click Connect and approve access in the browser.

Cursor

Add this to ~/.cursor/mcp.json (or .cursor/mcp.json in a project):

"mcpServers": { "webcrawlerapi": { "url": "https://mcp.webcrawlerapi.com/mcp" } } }

Open Cursor Settings, then MCP, and click Connect next to webcrawlerapi.

VS Code

Add this to .vscode/mcp.json (or run "MCP: Add Server" and choose HTTP):

"servers": { "webcrawlerapi": { "type": "http", "url": "https://mcp.webcrawlerapi.com/mcp" } } }

Start the server from the CodeLens above the entry and approve access in the browser.

MCP Inspector

npx @modelcontextprotocol/inspector

Pick transport "Streamable HTTP", URL https://mcp.webcrawlerapi.com/mcp, then use the OAuth flow in the Auth tab and call get_markdown.

ChatGPT

Open Settings, then Connectors, and turn on Developer mode (Advanced).
Create a connector with URL https://mcp.webcrawlerapi.com/mcp and authentication set to OAuth.
Enable the connector in a chat and approve access in the browser.

Menu names change between ChatGPT plans and releases. Custom connectors may not be available on every plan.

Tool reference

`get_markdown`

Fetch a public web page and return its main content as clean Markdown.

Input	Type	Required	Description
`url`	string	yes	Absolute `http://` or `https://` URL, up to 2048 characters

Returns the page as Markdown text. On failure the tool returns an error result with a short human-readable message (for example an unreachable site, a page blocked by robots.txt, a timeout, or an empty balance).

Annotations: read-only, idempotent, not destructive, open world (it reaches out to the public web).

Each call is billed to your WebCrawlerAPI organization. See https://webcrawlerapi.com/pricing.

Authentication

The server is an OAuth resource server. Clients discover the authorization server from https://mcp.webcrawlerapi.com/.well-known/oauth-protected-resource, which points to https://auth.webcrawlerapi.com.

Scope: markdown:read (the only scope)
Tokens are bound to the MCP server URL (resource indicator) and to the organization you approve.
You can review and revoke connected apps in the dashboard under Connected apps.
The server never forwards your token to other services.

Privacy and terms

The server receives the URLs you ask it to fetch and returns the page content. It does not log tokens or full URLs with query strings.

Pricing

Usage is billed to your organization. Current prices: https://webcrawlerapi.com/pricing

Contributing

See CONTRIBUTING.md and the Code of Conduct. Changes are listed in CHANGELOG.md.

Support

support@webcrawlerapi.com. Security reports: see SECURITY.md.

Development

Requires Node 22 and pnpm.

pnpm install

cp .env.example .env # fill in the values pnpm dev # tsx watch pnpm lint && pnpm test && pnpm build

Configuration is via environment variables, see .env.example and CONTRIBUTING.md. Registry publishing steps are in docs/registry-verification.md.

License

MIT, see LICENSE.

WebCrawlerAPI

Overview

PopNx MCP’s three pillars

What you can do with it

Install

Before you install

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Compared with others in Web & browsersi

Common questions

Alternatives

Browser Use

Chrome DevTools MCP

MCP Server Browser

README from the maker

WebCrawlerAPI MCP server

Connect

Claude Code

Claude.ai and Claude Desktop

Cursor

VS Code

MCP Inspector

ChatGPT

Tool reference

get_markdown

Authentication

Privacy and terms

Pricing

Contributing

Support

Development

License

`get_markdown`