Crawlforge MCP Server

Name: Crawlforge MCP Server
Author: mysleekdesigns

by mysleekdesignsversion 6.25.0i★ –iRuns on your computer

Registry nameio.github.mysleekdesigns/crawlforge-mcp-server

Install

Overview

Description from the maker (original English)

Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

User voiceiNo reviews yetReviews open together with accounts in a later step
Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
UsageiNot measured yet★ –

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs on your computer
Transport: stdio
Category: Web & browsers
You need to fill in: CRAWLFORGE_API_KEY, DATAFORSEO_LOGIN, DATAFORSEO_PASSWORD

Install

Pick the AI app you use, then copy the settings.

Before you install

Basic checks: 1 of 1 passed
Runs on your computer with your user’s permissions (files, network, apps).
You fill in yourself: CRAWLFORGE_API_KEY, DATAFORSEO_LOGIN, DATAFORSEO_PASSWORD

Values marked secret are keys to your account. Never share them or paste them into a chat.

You need

npmNode.js installed (for the npx command)

Which app do you use?

ClaudeClaude CodeCursorVS CodeChatGPT

Pick your app above. We remember it, so next time the button says “Install in …”.

Open Claude Desktop → Settings → Developer → Edit Config, and paste this into claude_desktop_config.json

{
  "mcpServers": {
    "crawlforge": {
      "command": "npx",
      "args": [
        "-y",
        "crawlforge-mcp-server"
      ],
      "env": {
        "CRAWLFORGE_API_KEY": "your-value",
        "DATAFORSEO_LOGIN": "your-value",
        "DATAFORSEO_PASSWORD": "your-value"
      }
    }
  }
}

Run this in your terminal

claude mcp add crawlforge --env CRAWLFORGE_API_KEY=your-value --env DATAFORSEO_LOGIN=your-value --env DATAFORSEO_PASSWORD=your-value -- npx -y crawlforge-mcp-server

Fill in the empty values before running it.

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "crawlforge": {
      "command": "npx",
      "args": [
        "-y",
        "crawlforge-mcp-server"
      ],
      "env": {
        "CRAWLFORGE_API_KEY": "your-value",
        "DATAFORSEO_LOGIN": "your-value",
        "DATAFORSEO_PASSWORD": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "crawlforge": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "crawlforge-mcp-server"
      ],
      "env": {
        "CRAWLFORGE_API_KEY": "your-value",
        "DATAFORSEO_LOGIN": "your-value",
        "DATAFORSEO_PASSWORD": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

This one runs on your computer, and ChatGPT can only connect to servers on the internet. Pick another app.

Your choice stays on this device in a cookie; no account needed.

Values you fill in

CRAWLFORGE_API_KEY secret required env
CrawlForge API key for authentication and usage/credit tracking. Get a free key at https://www.crawlforge.dev
DATAFORSEO_LOGIN secret env
DataForSEO account login. Optional — only needed to enable the serp_rank tool (real Google organic rank lookups); billed separately to the caller's own DataForSEO account.
DATAFORSEO_PASSWORD secret env
DataForSEO account password. Optional — only needed to enable the serp_rank tool.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 7, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account mysleekdesigns, which owns the repo
… Not checked yet
Still maintained
We have not read this repo from GitHub yet
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
– Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
– Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
… Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints

Compared with others in Web & browsersi

More stars than 0% of the other 881 servers in this category
Published to the registry more recently than 80% of the other 881 servers in this category
Basic checks equal to or better than 100% of the other 881 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Crawlforge MCP Server safe?

It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: CRAWLFORGE_API_KEY, DATAFORSEO_LOGIN, DATAFORSEO_PASSWORD

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed –, and the latest version (6.25.0) reached the registry 9 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js on your computer.

What can I use instead?

In the same category: Browser Use, Chrome DevTools MCP, MCP Server Browser

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Browser Use

by browser-use

Lets AI do web tasks for you, such as filling forms, searching and extracting data, in the maker’s cloud browsers or on your computer.

Computer or cloud★ 120,087MITUpdated 17 days ago

Install

Chrome DevTools MCP

by ChromeDevTools

Lets AI use Chrome’s developer tools to inspect pages, find what makes them slow and spot errors. Made by the Chrome DevTools team.

Runs on your computer★ 54,821Apache-2.0Updated 16 days ago

Install

MCP Server Browser

by bytedance

MCP server for browser use access

Runs on your computer★ 39,550Apache-2.0Updated 14 months ago

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

31 web scraping, crawling, deep-research & autonomous-extraction tools for Claude, Cursor & any MCP client.

Clean Markdown & structured JSON from any site. Get started with 1,000 free credits — no credit card required.

⭐ Star us on GitHub to follow along — it genuinely helps others discover the project.

Why CrawlForge?
CrawlForge vs. alternatives
Quick Start (2 Minutes)
Available Tools
Pricing
Advanced Configuration
Usage Examples
Security & Privacy
Support
Contributing

🎯 Why CrawlForge?

31 MCP-native tools — scraping, crawling, search, real Google SERP rank tracking, deep research, an autonomous agent, a unified multi-format scrape, document processing, stealth browsing, stateful browser sessions, and more, callable directly from your AI assistant.
Generous free tier — 1,000 credits to start instantly, no credit card. The grant is one-time rather than monthly, and the credits never expire.
Local-LLM by default — extract_with_llm runs against a local Ollama model out of the box: no LLM API key, no per-token cost, and your data never leaves your machine. Cloud (OpenAI/Anthropic) is opt-in.
LLM-ready output — clean Markdown, structured JSON (schema-driven), screenshots, links, and metadata from a single fetch.
Autonomous `agent` — describe what you need in natural language; it plans, gathers, and shapes an answer under orchestrator-enforced hard stops (max steps/URLs/wall-clock) — no URLs required.
Security-hardened — SSRF protection on every request, a fail-closed backend allow-list, a vetted action allowlist for browser automation, and per-tool credit gating.
Works everywhere MCP does — Claude Desktop, Claude Code, Cursor, and any other MCP-enabled client, configured in one command.

📊 CrawlForge vs. alternatives

	CrawlForge MCP	Firecrawl	Raw scraping API
Native MCP server	✅ 31 tools	✅	❌
Free tier	✅ 1,000 credits, one-time, never expire	Limited	Varies
Self-hosted / local LLM extraction (Ollama)	✅ default, $0/token	❌	❌
Autonomous agent (no URLs needed)	✅ `agent`	✅	❌
Deep research with source verification	✅ `deep_research`	Partial	❌
Browser automation / actions	✅ `scrape_with_actions`	✅	Varies
Stealth / anti-detection engines	✅ Chromium + Camoufox	✅	Add-on
Pre-built site templates	✅ 10 sites	❌	❌
License	MIT	AGPL-3.0	Proprietary

Comparison reflects publicly documented capabilities at time of writing. CrawlForge is MIT-licensed and MCP-first — built to plug straight into AI coding assistants.

🚀 Quick Start (2 Minutes)

1. Install from NPM

npm install -g crawlforge-mcp-server

2. Setup Your API Key (required)

Every tool requires a CrawlForge API key — new accounts get 1,000 free trial credits to start. The recommended path signs you in through the browser, so the key is never pasted into a terminal (a coding agent can run this for you and relay the URL):

crawlforge login

It prints an approval URL; open it, approve, and the key is stored in ~/.crawlforge/config.json. Then run crawlforge init to register the MCP server with your client. Or use the interactive wizard, which also configures your clients:

npx crawlforge-setup

This will:

Guide you through getting your free API key
Configure your credentials securely
Auto-configure Claude Code and Cursor (if installed)
Verify your setup is working

Don't have an API key? Get one free at https://www.crawlforge.dev/signup

One-step setup (v4.6.0+): crawlforge init detects your API key, installs the agent skill, and idempotently merges the MCP config stanza into Claude Code, Claude Desktop, and Cursor. Use crawlforge init --all --yes to configure every detected client non-interactively.

3. Configure Your IDE (if not auto-configured)

🤖 For Claude Desktop

Add to claude_desktop_config.json:

"mcpServers": { "crawlforge": { "command": "npx", "args": ["-y", "crawlforge-mcp-server"] } } }

Location:

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
Windows: %APPDATA%/Claude/claude_desktop_config.json
Linux: ~/.config/Claude/claude_desktop_config.json

Restart Claude Desktop to activate.

🖥️ For Claude Code CLI (Auto-configured)

The setup wizard automatically configures Claude Code by adding to ~/.claude.json:

"mcpServers": { "crawlforge": { "type": "stdio", "command": "crawlforge-mcp" } } }

After setup, restart Claude Code to activate.

💻 For Cursor IDE (Auto-configured)

The setup wizard automatically configures Cursor by adding to ~/.cursor/mcp.json:

"mcpServers": { "crawlforge": { "type": "stdio", "command": "crawlforge-mcp" } } }

Restart Cursor to activate.

🔁 For n8n (workflow automation)

n8n's built-in MCP Client Tool node connects over Streamable HTTP (works on n8n Cloud and self-hosted). Run the server in HTTP mode:

export CRAWLFORGE_API_KEY=your_api_key

npm run start:http # Streamable HTTP endpoint at http://localhost:10000/mcp

Then point the MCP Client Tool node at http:// :10000/mcp with transport HTTP Streamable and a Bearer credential set to the same API key. On self-hosted n8n you can instead use the community n8n-nodes-mcp node over STDIO (npx -y crawlforge-mcp-server).

Full guide: docs/n8n-integration.md

Which launch command? npx -y crawlforge-mcp-server needs no global install and always runs the published version (recommended for Claude Desktop). For a global install (npm i -g crawlforge-mcp-server), use the dedicated crawlforge-mcp bin — it resolves on your PATH, so it survives Node/nvm version switches. The bare crawlforge command still launches the server when an MCP client spawns it over stdio (backward compatibility for configs created before v4.2.5); interactively it's the CLI — run crawlforge mcp to start the server by hand.

📊 Available Tools

CrawlForge requires a CrawlForge API key — every tool is metered and consumes credits. New accounts get 1,000 free trial credits to start. Get a key at crawlforge.dev/signup.

All Tools (API key required)

Tool	Credits	What it does
`fetch_url`	1	Fetch content from any URL
`extract_text`	1 (6 projected with `escalate: true`, charged 1 when the plain fetch works)	Extract clean text from web pages
`extract_links`	1 (6 projected with `escalate: true`, charged 1 when the plain fetch works)	Get all links from a page
`extract_metadata`	1	Extract page metadata (title, OG tags, schema.org)
`scrape_template`	1	Structured data from well-known sites (Amazon, GitHub, LinkedIn, YouTube, Reddit, Hacker News, npm, and more) without writing selectors
`list_ollama_models`	1	List the Ollama models installed locally (helps you pick a `model` for `extract_with_llm`)
`get_batch_results`	1	Retrieve paginated results for a `batch_scrape` job by `batchId`
`read_result`	1	Search, slice, read lines or a JSON path from a result a tool returned with `truncated: true` and a `result_handle` (kept 1 hour on your own machine) — never fetch the page again
`scrape`	2	Unified single-fetch, multi-format extraction. Pass a `formats` array (markdown/html/rawHtml/text/links/metadata/screenshot/json-schema, plus `{type:"highlights",query}` and `{type:"question",question}` for only the matching sentences, table rows and code blocks, verbatim with offsets into the markdown: +1 credit once per call, `mode:"model"` +3) plus `onlyMainContent`; one fetch serves every requested format with per-format partial-success warnings. `escalate:true` retries a blocked plain fetch once in the stealth browser and returns the page instead of the block (+5 as the projected ceiling; the charge drops back to 2 when the plain fetch succeeded and no escalation ran)
`scrape_structured`	2	Extract structured data with CSS selectors
`extract_embedded_state`	2 (7 projected with `escalate: true`, charged 2 when the plain fetch works)	Read a page's embedded JavaScript state — `__NEXT_DATA__`, React Server Component payloads (references between rows resolved, plus a `data_rows` index), Nuxt (Nuxt 3's `__NUXT_DATA__` decoded), SvelteKit, Apollo, Redux, `ytInitialData`, Inertia, Shopify, JSON `data-*` attributes, — with a `path` to scope the result, `keys_only: true` to see its first two levels of keys, or `find: " "` to get every path where a field of that name lives. `escalate: true` re-reads a walled page in the stealth browser, runs the same parser and also reads the framework globals off `window` (`window_state`). No LLM in the extraction path
`extract_content`	2	Enhanced content extraction
`map_site`	2	Discover and map website structure (optional `search=` ranks the discovered URLs)
`process_document`	2	Multi-format document processing
`localization`	2	Look up a country's locale settings (Accept-Language, timezone, currency) to pass to other tools; returns values, applies none
`track_changes`	3	Monitor content changes over time
`analyze_content`	3	Comprehensive content analysis
`extract_structured`	3	LLM-powered schema-driven extraction (your own LLM key or local Ollama)
`extract_with_llm`	3	Natural-language extraction. Defaults to a local Ollama model; pass `provider: "openai" \	"anthropic"` with the matching key for cloud models (external LLM billed by your provider)

| browser_session | 3 | A browser page that stays open across calls, keeping its cookies and its login in between. open a session on a URL, snapshot it to list the interactive elements as stable refs (@e1, @e2), act on a ref, read the content, close. Priced per operation: open 3, read 2, snapshot/act/screenshot/close/list 1 each. Reach for it when you must see the page before choosing what to click, when the flow spans several calls, or when a login must hold across later reads; one fixed act

Only the beginning is shown; read the rest in the repo

Crawlforge MCP Server

Overview

PopNx MCP’s three pillars

What you can do with it

Install

Before you install

Values you fill in

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Compared with others in Web & browsersi

Common questions

Alternatives

Browser Use

Chrome DevTools MCP

MCP Server Browser

README from the maker

Table of Contents

🎯 Why CrawlForge?

📊 CrawlForge vs. alternatives

🚀 Quick Start (2 Minutes)

1. Install from NPM

2. Setup Your API Key (required)

3. Configure Your IDE (if not auto-configured)

📊 Available Tools