World Monitor
Real-time global intelligence on conflict, markets, energy, trade, shipping and cyber. 102 tools.
Runs in the cloud✓ worldmonitor.app
Crawlbit
Overview
Description from the maker (original English)
Four free tools to check if AI engines can find, read and recognise a site. No API key.
What you can do with it
We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.
- Connection: Runs on your computer
- Transport: stdio
- Category: Other
Install
Pick the AI app you use, then copy the settings.
Passed 2/2 checks · Runs on your computer
First: which AI do you use?
Pick your app and the steps appear below.
Works with Claude, with some setup first
You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
Install Node.js
One time only; it works for every server that needs Node.js
Sign up and create a Crawlbit key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Open the Claude desktop app’s settings file
SettingsDeveloperEdit Config
Paste these settings and save the file
{ "mcpServers": { "crawlbit": { "command": "npx", "args": [ "-y", "crawlbit-mcp" ], "env": { "CRAWLBIT_BASE_URL": "your-value" } } } }Paste the key only into the app’s field, never into a chat or to anyone
Quit Claude and open it again
Try it
Use Crawlbit and tell me what you can do for me, then show me one thing✓ If Claude says it is using Crawlbit or shows a Crawlbit tool in the answer, you are connected
Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version
ChatGPT cannot connect Crawlbit yet
Crawlbit runs on your computer, but ChatGPT can only connect servers that run on the web
What you can do instead
A · Use an app that can connect Crawlbit
- You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time) · Only the Claude desktop app (Windows or Mac), not the web or phone
- You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time)
- You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time)
- You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time)
B · Others in Other that work with ChatGPT
Picked from the most used in the same category, only ones that connect by address with no key
- Hostinger✓ ChatGPT
- World Monitor✓ ChatGPT
- Svelte MCP✓ ChatGPT
Works with Claude Code, with some setup first
You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time)
Install Node.js
One time only; it works for every server that needs Node.js
Sign up and create a Crawlbit key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Open Terminal
Mac: press Command+Space and type Terminal · Windows: open PowerShell
Paste this command and press Enter
claude mcp add crawlbit --env CRAWLBIT_BASE_URL=your-value -- npx -y crawlbit-mcpReplace “your-value” with your key before pressing Enter
Paste the key only into the app’s field, never into a chat or to anyone
Type /mcp in Claude Code
You should see Crawlbit listed as connected
Try it
Use Crawlbit and tell me what you can do for me, then show me one thing✓ If Claude Code says it is using Crawlbit or shows a Crawlbit tool in the answer, you are connected
Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version
Works with Cursor, with some setup first
You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time)
Install Node.js
One time only; it works for every server that needs Node.js
Sign up and create a Crawlbit key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Fill in your key
In the Crawlbit settings, CRAWLBIT_BASE_URL is empty; add your key and save
Paste the key only into the app’s field, never into a chat or to anyone
Open the AI chat in Cursor in Agent mode
Try it
Use Crawlbit and tell me what you can do for me, then show me one thing✓ If Cursor says it is using Crawlbit or shows a Crawlbit tool in the answer, you are connected
Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version
Works with VS Code, with some setup first
You need a Crawlbit key (sign up on the maker’s site, may cost money) · Install Node.js on your computer first (one time)
Install Node.js
One time only; it works for every server that needs Node.js
Sign up and create a Crawlbit key
Open the maker’s site, sign up and create an API key for the next step. It may cost money.
How to get a key is in the maker’s README below
Fill in your key
In the Crawlbit settings, CRAWLBIT_BASE_URL is empty; add your key and save
Paste the key only into the app’s field, never into a chat or to anyone
Open the AI chat in VS Code in Agent mode
Try it
Use Crawlbit and tell me what you can do for me, then show me one thing✓ If VS Code says it is using Crawlbit or shows a Crawlbit tool in the answer, you are connected
Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version
For developers: Terminal commands and JSON settings
Installed on your computer
Claude Code
claude mcp add crawlbit --env CRAWLBIT_BASE_URL=your-value -- npx -y crawlbit-mcpClaude Desktop (claude_desktop_config.json)
{
"mcpServers": {
"crawlbit": {
"command": "npx",
"args": [
"-y",
"crawlbit-mcp"
],
"env": {
"CRAWLBIT_BASE_URL": "your-value"
}
}
}
}Cursor (~/.cursor/mcp.json)
{
"mcpServers": {
"crawlbit": {
"command": "npx",
"args": [
"-y",
"crawlbit-mcp"
],
"env": {
"CRAWLBIT_BASE_URL": "your-value"
}
}
}
}VS Code (mcp.json)
{
"servers": {
"crawlbit": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"crawlbit-mcp"
],
"env": {
"CRAWLBIT_BASE_URL": "your-value"
}
}
}
}Values you fill in
CRAWLBIT_BASE_URLenvOptional. Point the server at another CrawlBit instance. Defaults to https://www.crawlbit.app. No API key or account is needed to use this server.
These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.
At a glance
Which apps can use it
Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.
Run on your computer in
ClaudeGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatRaycast
Related guides
What it can do
Runs on your computer; the tool list appears in your AI app after you install it.
Basic checksi
We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 11, 2026
- ✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account amati032-dev, which owns the repo
- ✓ Pass
Still maintained
Code last changed 3 months ago
- … Not checked yet
Has a licence
We have not read this repo from GitHub yet
- – Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
- – Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
- … Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints
Discussion
Ask, share a tip or report that it does not work. Sorted by what people marked helpful.
No posts yet. Be the first to ask or share.
Posts here are written by users, not the PopNx team.
User reviews
No reviews yet
Compared with others in Otheri
- More stars than 86% of the other 19162 servers in this category
- Published to the registry more recently than 20% of the other 19162 servers in this category
- Basic checks equal to or better than 100% of the other 19162 servers in this category
Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.
Common questions
Is Crawlbit safe?
It passed 2 of 2 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.
What keys or codes does it need?
The registry does not list a required key, though some servers ask you to sign in on first use.
Does it run on my computer or in the cloud?
It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).
Is it still maintained?
The GitHub repo last changed 3 months ago, and the latest version (1.0.1) reached the registry 3 months ago.
Which apps can use it?
Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js on your computer.
What can I use instead?
In the same category: World Monitor, Claude Flow, Tldraw
Alternatives
Servers in the same category from other makers, sorted by stars.
Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi
Claude Flow
AI orchestration with hive-mind swarms, neural networks, and 87 MCP tools for enterprise dev.
Runs on your computer
README from the maker
Open the README
Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.
CrawlBit MCP
Four free tools that answer one question: can AI engines find, read and recognise a website?
No account. No API key. No signup. Nothing here runs a language model, so nothing here costs you or us anything.
"Can ChatGPT read stripe.com?""Why does AI never mention my store?" "Where is my brand missing outside my own site?"
Ask in plain language. Your AI client picks the right tool.
Install
Requires Node.js 18+.
Claude Code
claude mcp add crawlbit -- npx -y crawlbit-mcpClaude Desktop
Add to claude_desktop_config.json:
{"mcpServers": { "crawlbit": { "command": "npx", "args": ["-y", "crawlbit-mcp"] } } }
Cursor
Add to .cursor/mcp.json:
{"mcpServers": { "crawlbit": { "command": "npx", "args": ["-y", "crawlbit-mcp"] } } }
Restart your client. Four tools appear.
The four tools
| Tool | What it answers |
|---|---|
crawlbit_crawler_watch | Can GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Google-Extended read this site? |
crawlbit_entity_check | Does this brand read as a clear entity AI can recognise? |
crawlbit_offpage_gaps | Where is this brand missing outside its own website? |
crawlbit_shopping | Can AI shopping agents understand and recommend these products? |
Try these
Check whether AI crawlers can read example.comDoes example.com read as a clear brand entity to AI? Where is example.com missing off-page, and which gap should we close first? Compare example.com and competitor.com on AI crawler access
The tools compose. A useful sequence is: crawler access first (a blocked crawler makes everything else pointless), then the entity check, then the off-page gaps.
What this does NOT do
Written plainly, because an SEO tool that overstates itself is worse than no tool.
- It does not test whether AI actually cites a brand. That means running real buyer questions against ChatGPT, Perplexity and Claude, reading the answers, and reporting who gets named instead of you. It costs real money per run and is not part of this free surface. These four tools measure the conditions that make a citation possible, which is a smaller claim.
- `crawler_watch` reads `robots.txt` only. It cannot see blocking done at the CDN, firewall or rate-limit layer. A site can pass here and still refuse the crawler in practice.
- `entity_check` reads what the site publishes about itself. It says nothing about the brand's reputation across the rest of the web.
- `shopping` inspects published structured data. It cannot see a merchant feed submitted privately to a platform.
If a site scores well on all four and still is not cited, the answer is almost always the same and it is not technical: too few third-party pages mention it. These tools will tell you that honestly rather than sell you a fix that does not exist.
Why only four tools
CrawlBit also runs a full technical audit and generates llms.txt. Both use a language model, so both cost money per run, and neither is exposed here.
That is a deliberate line rather than a teaser. A free tool whose bill grows with its popularity gets rate-limited, degraded or withdrawn the moment it succeeds, and the people who installed it are the ones who pay for that. Everything in this server costs nothing to run, so nothing here has to be taken back later. The audit and the llms.txt generator live at crawlbit.app if you want them.
Rate limit
The API rate-limits per IP. Normal conversational use does not come close, and the server runs on your machine, so the budget is yours rather than shared. If you do hit it, you get a plain sentence rather than a stack trace.
Configuration
| Variable | Default | Purpose |
|---|---|---|
CRAWLBIT_BASE_URL | https://www.crawlbit.app | Point the server at another instance |
Privacy
The server runs locally and stores nothing. The only data leaving your machine is the URL you ask about, sent to the CrawlBit API to be analysed. There is no account, so there is nothing to tie a request to a person.
About
Built by CrawlBit, which measures AI visibility and does the off-page work that earns citations. The free tools here are the measurement half. The paid work is the other half, and you are not required to look at it to use this.
MIT licensed. Issues and pull requests welcome.