Browser Use
by browser-use
Lets AI do web tasks for you, such as filling forms, searching and extracting data, in the maker’s cloud browsers or on your computer.
Computer or cloud★ 120,087MITUpdated 17 days ago
Install
Web Crawler MCP by InsightfulPipe
Overview
Description from the maker (original English)
Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
PopNx MCP’s three pillars
These three are never merged into one score: opinions, measurements and popularity are different things.
- User voiceiNo reviews yetReviews open together with accounts in a later step
- Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
- UsageiNot measured yet★ –
What you can do with it
We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.
- Connection: Runs in the cloud
- Transport: Streamable HTTP
- Category: Web & browsers
Install
Pick the AI app you use, then copy the settings.
Before you install
- Basic checks: 1 of 1 passed
- Runs on the maker’s server: what you ask it goes through their server.
- The registry lists no key to fill in.
You need
- Runs in the cloudNothing to install; it connects over the internet
Which app do you use?
Pick your app above. We remember it, so next time the button says “Install in …”.
Works in Claude on the web, desktop and mobile:
- Open Settings → Connectors
- Press Add custom connector
- Paste the address below and press Add
- If it asks you to sign in, sign in with the maker
https://crawler.insightfulmcp.com/Run this in your terminal
claude mcp add --transport http crawler https://crawler.insightfulmcp.com/Or copy the settings yourself
Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json
{
"mcpServers": {
"crawler": {
"url": "https://crawler.insightfulmcp.com/"
}
}
}Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.
Or copy the settings yourself
Paste into .vscode/mcp.json in your project
{
"servers": {
"crawler": {
"type": "http",
"url": "https://crawler.insightfulmcp.com/"
}
}
}Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.
ChatGPT connects only to servers on the internet:
- Open ChatGPT on the web → Settings → Connectors (Apps)
- Press Create or Add (some plans need Developer mode under Advanced first)
- Paste the address below, give it a name and save
- If it asks you to sign in, sign in with the maker
https://crawler.insightfulmcp.com/Menu names can differ slightly by plan and over time.
Your choice stays on this device in a cookie; no account needed.
These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.
What it can do
We have not read this server’s tool list yet; we check endpoints in rotation.
Basic checksi
We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 6, 2026
- ✓ Pass
Maker matches the repo
The registry name was verified against the domain insightfulpipe.com (the registry checks domain ownership)
- … Not checked yet
Still maintained
We have not read this repo from GitHub yet
- … Not checked yet
Has a licence
We have not read this repo from GitHub yet
- … Not checked yet
Endpoint responds
Not checked yet; we check endpoints in rotation
- … Not checked yet
Sign-in with OAuth
Not checked yet; we check endpoints in rotation
- … Not checked yet
No hidden instructions in tool descriptions
Not checked yet; we read the tool list when we check the endpoint
Compared with others in Web & browsersi
- More stars than 0% of the other 878 servers in this category
- Published to the registry more recently than 66% of the other 878 servers in this category
- Basic checks equal to or better than 100% of the other 878 servers in this category
Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.
Common questions
Is Web Crawler MCP by InsightfulPipe safe?
It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.
What keys or codes does it need?
The registry does not list a required key, though some servers ask you to sign in on first use.
Does it run on my computer or in the cloud?
It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.
Is it still maintained?
The GitHub repo last changed –, and the latest version (1.0.0) reached the registry 17 days ago.
Which apps can use it?
Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT in developer mode.
What can I use instead?
In the same category: Browser Use, Chrome DevTools MCP, MCP Server Browser
Alternatives
Servers in the same category from other makers, sorted by stars.
Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi
Chrome DevTools MCP
by ChromeDevTools
Lets AI use Chrome’s developer tools to inspect pages, find what makes them slow and spot errors. Made by the Chrome DevTools team.
Runs on your computer★ 54,821Apache-2.0Updated 15 days ago
Install
MCP Server Browser
by bytedance
MCP server for browser use access
Runs on your computer★ 39,550Apache-2.0Updated 14 months ago
Install
README from the maker
Open the README
Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.
Web Crawler MCP Server (SEO Crawler) by Insightful Pipe
Comprehensive SEO auditing and web crawling through AI with MCP.
Part of the Insightful Pipe MCP Server Collection — The Web Crawler MCP server enables Claude, ChatGPT, Cursor, and other AI assistants to perform SEO audits, extract data, and analyze websites. Run 25+ specialized SEO checks, generate sitemaps, and extract brand information.
MCP Server URL
https://crawler.insightfulmcp.com/What is Web Crawler MCP?
Web Crawler MCP is a remote Model Context Protocol server that provides AI assistants with comprehensive SEO auditing and web crawling capabilities. This integration allows you to:
- Run 25+ specialized SEO checkers on any URL
- Generate XML sitemaps and robots.txt files
- Extract brand design elements from websites
- Audit technical SEO, content quality, and security
- Analyze mobile responsiveness and page speed
Installation
Claude
- Copy the MCP Server URL:
https://crawler.insightfulmcp.com/ - Open Claude Connectors Settings
- Scroll to the bottom and click Add custom connector
- Paste the URL and click Add
- Click Connect and sign in to InsightfulPipe if asked. Claude then lists the connector as connected.
ChatGPT
Custom MCP servers are added through ChatGPT's Developer mode. Availability depends on your ChatGPT plan, and workspace admins may need to allow it.
- Turn on Developer mode in ChatGPT settings
- Create a new app for a remote MCP server and paste the URL:
https://crawler.insightfulmcp.com/ - Sign in to InsightfulPipe if asked. The connection finishes as soon as you are signed in.
See OpenAI's guide: Developer mode and MCP apps in ChatGPT
Claude Code
claude mcp add --transport http crawler https://crawler.insightfulmcp.com/Cursor
Add the server to ~/.cursor/mcp.json (all projects) or .cursor/mcp.json (one project):
{"mcpServers": { "crawler": { "url": "https://crawler.insightfulmcp.com/" } } }
When Cursor shows Needs authentication, click Connect and sign in to InsightfulPipe if asked.
Available Actions
33 actions: 33 read, 0 write.
Read Actions (33)
Show all 33 read actions
| Action | Description |
|---|---|
ai-crawler-checker | Check permissions for AI training bots and crawlers |
amp-checker | Verify AMP implementation quality and discoverability |
brand-extractor | Extract brand design details from a website (colors, fonts, buttons, logos) |
canonical-checker | Validate canonical URLs and conflicting hints |
character-encoding-checker | Validate declared charset and encoding consistency |
content-optimizer-checker | Analyze on-page content quality and keyword density |
content-quality-checker | Score readability, word count, and duplication risk |
deprecated-html-checker | Detect obsolete tags or attributes still in use |
favicon-checker | Confirm favicon/icon discovery across devices |
headings-checker | Review heading hierarchy (H1-H6) for structure gaps |
hreflang-checker | Review international hreflang annotations |
image-optimization-checker | Check alt text, formats, and compression levels |
indexability-checker | Review robots/meta directives affecting indexation |
internal-linking-checker | Map internal links and surface opportunities |
language-checker | Verify html[lang] attributes and language targeting |
link-analysis-checker | Detect broken or low-quality links on page |
link-extractor | Extract all links from a page and categorize them (internal and external) |
llms-txt-checker | Parse llms.txt instructions for AI crawlers |
meta-tags-checker | Inspect meta title/description tags across the page |
mobile-responsive-checker | Audit responsive layout rules and breakpoints |
mobile-viewport-checker | Ensure viewport meta tags and responsive meta configs are in place |
page-load-checker | Measure page weight and render-blocking assets |
page-speed-checker | Measure load times and highlight slow resources |
robots-txt-checker | Parse robots.txt directives and highlight blocking issues |
robots-txt-generator | Generate robots.txt content with optional AI bot restrictions |
security-headers-checker | Check CSP/HSTS and other security headers |
seo-audit-checker | Comprehensive SEO audit covering technical and content issues |
sitemap-generator | Crawl the target domain and produce an XML sitemap |
social-media-checker | Validate Open Graph and Twitter Card metadata |
ssl-certificate-checker | Inspect certificate chain, expiry, and HTTPS enforcement |
status-code-checker | Trace HTTP status/redirect chains for a URL |
structured-data-checker | Validate Schema.org markup and structured data coverage |
url-structure-checker | Evaluate keyword usage and cleanliness of URLs |
Control What Your AI Can Do
You decide what AI agents can do with each connected account:
- Turn individual actions on or off for every connected account, so agents only see the actions you allow.
- Connect as Read-only or Read & Write. A read-only connection can only enable read actions.
- Destructive actions stay off by default. Actions such as deletes are disabled until an admin enables them.
- Team access per account. Restricted team members only use the accounts they are granted, with the read actions enabled on them.
Usage Examples
Full SEO Audit
"Run a comprehensive SEO audit on https://example.com"Check Technical SEO
"Check the robots.txt and indexability of https://example.com"Analyze Internal Links
"Map all the internal links on this page"Generate Sitemap
"Generate an XML sitemap for https://example.com"Extract Brand Elements
"Extract the brand colors, fonts, and logos from https://company.com"Security Audit
"Check the SSL certificate and security headers for this site"Why Web Crawler MCP?
For SEO Professionals
- Comprehensive audits - 25+ specialized checks
- Technical SEO - Robots, canonical, structured data
- Content analysis - Quality scoring and optimization
For Web Developers
- Debug issues - Find broken links, redirect chains
- Performance - Page speed and resource analysis
- Security - SSL and header validation
For Agencies
- Client audits - Quick site assessments
- Competitive analysis - Analyze competitor sites
- Reporting - Generate findings conversationally
Security & Privacy
- Secure requests - HTTPS support
Pricing
The Web Crawler MCP server is included in every InsightfulPipe plan, together with all other MCP servers and the CLI. Plans start at $29.99/month, and you can try it for 7 days. See insightfulpipe.com/pricing for current plans.
Ready-Made Skills and Prompts
- Claude skills for SEO and marketing — ready-made skills that run on your connected data
- Comprehensive SEO Site Audit
- Technical SEO Health Check
- Content Quality Assessment
Explore More MCP Servers by Insightful Pipe
Visit [insightfulpipe.com/mcp-servers](https://insightfulpipe.com/mcp-servers) to discover our full collection of MCP servers for marketing and analytics.
SEO & Performance MCP Servers
- PageSpeed MCP - Performance analysis
- Google Search Console MCP - Search analytics
- Screenshot MCP - Visual capture
- Google My Business MCP - Local SEO
Analytics MCP Servers
- Google Analytics MCP - Website analytics
- Enrichment MCP - Data enrichment
[View All MCP Servers →](https://insightfulpipe.com/mcp-servers)
Resources
Support
- Documentation: insightfulpipe.com/docs
- All MCP Servers: insightfulpipe.com/mcp-servers
- Email: support@insightfulpipe.com
[Insightful Pipe](https://insightfulpipe.com) — AI-powered marketing analytics through MCP servers. Explore all integrations →
License
MIT License - see LICENSE for details.