Scrapi

MCP server that converts URLs to clean Markdown/Text for LLM agents

한국어 · Website · Dashboard

⚡ Fast & Reliable — Built on 8+ years of web scraping expertise, 1,900+ production crawlers, and battle-tested anti-bot handling.

What is this?

An MCP (Model Context Protocol) server that lets AI agents fetch and read web pages. Simply give it a URL, and it returns clean, LLM-ready content — fast.

Before: AI can't read web pages directly After: "Summarize this article" just works ✨

---

Features

• 🌐 URL → Markdown: Preserves headings, lists, links
• 📄 URL → Text: Plain text extraction
• 🏷️ Metadata: Title, author, date, images
• 🧹 Clean Output: No ads, no navigation, no scripts
• ⚡ JavaScript Rendering: Works with SPAs
• 💳 Built-in Billing: Credit tracking, subscription management, usage analytics (MCP keys)
• 🔄 Auto-Retry: 429 rate limit responses automatically retried with Retry-After
• 🌍 Dual Transport: Stdio (npx) + Streamable HTTP for flexible deployment

---

Transport Modes

Scrapi MCP Server supports two transport modes:

---

Prerequisites

• Scrapi MCP account (separate from the main Scrapi account)
• Claude Desktop, Cline, or Cursor installed
• Node.js 20+

---

Installation

Option A: npx (Recommended)

No installation needed. Just configure your MCP client to use npx.

{

"mcpServers": { "scrapi": { "command": "npx", "args": ["-y", "@scrapi.ai/mcp-server"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Tip: You can also pass the API key via CLI argument instead of env var:

`json

"args": ["-y", "@scrapi.ai/mcp-server", "--api-key", "your-api-key"]

`

See Step 2 for where to put this configuration.

Option B: Install from Source

# Clone the repository

git clone https://github.com/bamchi/scrapi-mcp-server.git cd scrapi-mcp-server

Install dependencies and build

npm install && npm run build

---

Step 1: Get Your API Key

1. Go to https://scrapi.ai
2. Sign up or log in
3. Visit the MCP Dashboard — your Free plan (500 credits/month) and API key are created automatically
4. Copy your hsmcp_ API key

---

Step 2: Configure MCP Server

Claude Desktop

Option A: Via Settings (Recommended)

1. Open Claude Desktop
2. Click Settings (gear icon, bottom left)
3. Select Developer tab
4. Click "Edit Config" button
5. Add the mcpServers configuration (see below)
6. Save and restart Claude Desktop (Cmd+Q, then reopen)

Option B: Edit config file directly

• macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
• Windows: %APPDATA%\Claude\claude_desktop_config.json

Configuration (npx):

{

"mcpServers": { "scrapi": { "command": "npx", "args": ["-y", "@scrapi.ai/mcp-server"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Configuration (from source):

{

"mcpServers": { "scrapi": { "command": "node", "args": ["/absolute/path/to/scrapi-mcp-server/dist/index.js"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Note: Replace /absolute/path/to/ with the actual path where you cloned the repository.

Cline

Config file location:

• macOS: ~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json
• Windows: %APPDATA%\Code\User\globalStorage\saoudrizwan.claude-dev\settings\cline_mcp_settings.json

Configuration (npx):

{

"mcpServers": { "scrapi": { "command": "npx", "args": ["-y", "@scrapi.ai/mcp-server"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Configuration (from source):

{

"mcpServers": { "scrapi": { "command": "node", "args": ["/absolute/path/to/scrapi-mcp-server/dist/index.js"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Cursor

Create or edit .cursor/mcp.json in your project root:

Configuration (npx):

{

"mcpServers": { "scrapi": { "command": "npx", "args": ["-y", "@scrapi.ai/mcp-server"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Configuration (from source):

{

"mcpServers": { "scrapi": { "command": "node", "args": ["/absolute/path/to/scrapi-mcp-server/dist/index.js"], "env": { "SCRAPI_API_KEY": "your-api-key" } } } }

Claude Code

Option 1: CLI command (Recommended)

claude mcp add scrapi-ai -s user -e SCRAPI_API_KEY=your-api-key -- npx -y @scrapi.ai/mcp-server

Or with --api-key:

claude mcp add scrapi-ai -s user -- npx -y @scrapi.ai/mcp-server --api-key your-api-key

Option 2: Edit config file

Edit ~/.claude.json or project .mcp.json:

{

"mcpServers": { "scrapi": { "command": "npx", "args": ["-y", "@scrapi.ai/mcp-server", "--api-key", "your-api-key"] } } }

Streamable HTTP

Connect via Streamable HTTP — no Node.js installation needed on the client side.

Endpoint: https://scrapi.ai/mcp

Cursor (.cursor/mcp.json):

{

"mcpServers": { "scrapi": { "url": "https://scrapi.ai/mcp", "headers": { "Authorization": "Bearer your-api-key" } } } }

Claude Code (CLI):

claude mcp add --transport http scrapi https://scrapi.ai/mcp \

--header "Authorization: Bearer your-api-key"

Cline (cline_mcp_settings.json):

{

"mcpServers": { "scrapi": { "type": "streamableHttp", "url": "https://scrapi.ai/mcp", "headers": { "Authorization": "Bearer your-api-key" } } } }

Claude Desktop (claude_desktop_config.json):

{

"mcpServers": { "scrapi": { "command": "npx", "args": [ "mcp-remote", "https://scrapi.ai/mcp", "--header", "Authorization: Bearer your-api-key" ] } } }

Note: Claude Desktop requires the mcp-remote proxy for HTTP connections.

Self-host the HTTP server (advanced)

Run your own instance instead of using the hosted endpoint:

SCRAPI_API_KEY=your-api-key npx -y -p @scrapi.ai/mcp-server scrapi-http

or from source:

SCRAPI_API_KEY=your-api-key node dist/http.js

The server starts at http://localhost:3000 with the MCP endpoint at /mcp. Configure with PORT and HOST environment variables. Replace the URL in the client configurations above with your self-hosted URL (e.g. http://localhost:3000/mcp).

Health check: GET http://localhost:3000/health

---

Step 3: Restart Your AI Client

• Claude Desktop: Fully quit (Cmd+Q on macOS, Alt+F4 on Windows) and reopen
• Claude Code: Restart the session
• Cline: Restart VS Code
• Cursor: Restart the editor

You should see the MCP server connection indicator.

---

Available Tools

scrape_url

Scrapes a webpage and returns AI-readable content.

Parameters:

Example:

{

"url": "https://example.com/article", "format": "markdown" }

Markdown Output:

# Article Title

Author: John Doe | Published: 2024-01-15

Introduction

This is the main content of the article, converted to clean markdown...

Key Points

• Point 1: Important detail
• Point 2: Another insight
• Related Link

Text Output:

Article Title

Author: John Doe | Published: 2024-01-15

Introduction

This is the main content of the article, converted to plain text...

Key Points

• Point 1: Important detail
• Point 2: Another insight

scrape_urls

Scrapes multiple webpages in parallel and returns AI-readable content.

Parameters:

Example:

{

"urls": ["https://example.com/page1", "https://example.com/page2"], "format": "text" }

Output:

[

{ "url": "https://example.com/page1", "content": "Page 1 Title\n\nThis is the content of page 1..." }, { "url": "https://example.com/page2", "content": "Page 2 Title\n\nThis is the content of page 2..." } ]

scraper_server_status

Check the status of all ScraperServer instances. Shows server health, circuit breaker state, failure counts, and timing info.

Parameters: None

Example:

{}

Output:

## ScraperServer Status

Total: 3 | Available: 2

Issues

• mars: Connection refused - connect(2)
• venus: Circuit breaker open until 01/30 12:30:00
• venus: Net::ReadTimeout

Status values:

get_usage

Check your API usage and remaining credits.

Parameters: None

Example:

{}

Output:

## MCP Credits

get_billing

Retrieve detailed billing information including subscription, plans, daily usage, and spending limits.

Parameters:

Example — Current subscription:

{ "action": "subscription" }

## MCP Subscription

| Item | Val