Scrapingdog
Overview
Description from the maker (original English)
Scrapingdog web-scraping & SERP APIs: web scrape, Google, Amazon, LinkedIn, YouTube, and more.
PopNx MCP’s three pillars
These three are never merged into one score: opinions, measurements and popularity are different things.
- User voiceiNo reviews yetReviews open together with accounts in a later step
- Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
- UsageiVery new↓ 49/wk · ★ –
What you can do with it
We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.
- Connection: Runs on your computer
- Transport: stdio
- Category: Marketing & social media
- You need to fill in: SCRAPINGDOG_API_KEY
Install
Pick the AI app you use, then copy the settings.
Before you install
- Basic checks: 1 of 1 passed
- Runs on your computer with your user’s permissions (files, network, apps).
- You fill in yourself:
SCRAPINGDOG_API_KEY,SCRAPINGDOG_API_BASE,SCRAPINGDOG_TIMEOUT_MS
Values marked secret are keys to your account. Never share them or paste them into a chat.
You need
- npmNode.js installed (for the npx command)
Which app do you use?
Pick your app above. We remember it, so next time the button says “Install in …”.
Open Claude Desktop → Settings → Developer → Edit Config, and paste this into claude_desktop_config.json
{
"mcpServers": {
"scrapingdog": {
"command": "npx",
"args": [
"-y",
"scrapingdog-mcp"
],
"env": {
"SCRAPINGDOG_API_KEY": "your-value",
"SCRAPINGDOG_API_BASE": "your-value",
"SCRAPINGDOG_TIMEOUT_MS": "your-value"
}
}
}
}Run this in your terminal
claude mcp add scrapingdog --env SCRAPINGDOG_API_KEY=your-value --env SCRAPINGDOG_API_BASE=your-value --env SCRAPINGDOG_TIMEOUT_MS=your-value -- npx -y scrapingdog-mcpFill in the empty values before running it.
Or copy the settings yourself
Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json
{
"mcpServers": {
"scrapingdog": {
"command": "npx",
"args": [
"-y",
"scrapingdog-mcp"
],
"env": {
"SCRAPINGDOG_API_KEY": "your-value",
"SCRAPINGDOG_API_BASE": "your-value",
"SCRAPINGDOG_TIMEOUT_MS": "your-value"
}
}
}
}Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.
Or copy the settings yourself
Paste into .vscode/mcp.json in your project
{
"servers": {
"scrapingdog": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"scrapingdog-mcp"
],
"env": {
"SCRAPINGDOG_API_KEY": "your-value",
"SCRAPINGDOG_API_BASE": "your-value",
"SCRAPINGDOG_TIMEOUT_MS": "your-value"
}
}
}
}Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.
This one runs on your computer, and ChatGPT can only connect to servers on the internet. Pick another app.
Your choice stays on this device in a cookie; no account needed.
Values you fill in
- Your Scrapingdog API key (from https://www.scrapingdog.com/ dashboard).
SCRAPINGDOG_API_BASEenvOverride the Scrapingdog API base URL.SCRAPINGDOG_TIMEOUT_MSenvPer-request timeout in milliseconds.
These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.
What it can do
Runs on your computer; the tool list appears in your AI app after you install it.
Basic checksi
We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 9, 2026
- ✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account Darshan972, which owns the repo
- … Not checked yet
Still maintained
We have not read this repo from GitHub yet
- … Not checked yet
Has a licence
We have not read this repo from GitHub yet
- – Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
- – Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
- … Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints
Compared with others in Marketing & social mediai
- More stars than 0% of the other 3622 servers in this category
- Published to the registry more recently than 21% of the other 3622 servers in this category
- Basic checks equal to or better than 100% of the other 3622 servers in this category
Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.
Common questions
Is Scrapingdog safe?
It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.
What keys or codes does it need?
You need to fill in: SCRAPINGDOG_API_KEY
Does it run on my computer or in the cloud?
It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).
Is it still maintained?
The GitHub repo last changed –, and the latest version (0.1.1) reached the registry 3 months ago.
Which apps can use it?
Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Node.js on your computer.
What can I use instead?
In the same category: MCP YouTube Transcript, Google Analytics MCP, BibiGPT YouTube Video Summarizer
Alternatives
Servers in the same category from other makers, sorted by stars.
Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi
Google Analytics MCP
GA4 MCP server for AI agents: schema discovery, server-side aggregation, analysis-ready defaults.
BibiGPT YouTube Video Summarizer
AI video summarizer: summarize and transcribe YouTube, Bilibili, TikTok and podcast videos.
README from the maker
Open the README
Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.
Scrapingdog MCP Server
The Model Context Protocol server for the Scrapingdog APIs, hosted at `https://mcp.scrapingdog.com/mcp`.
It gives an AI assistant 35 tools for live web data — Google SERPs, Maps, News, Shopping, Lens, Amazon, LinkedIn, YouTube, X, Walmart, eBay, screenshots and a general-purpose scraper — each backed by the corresponding Scrapingdog endpoint.
There is nothing to install. Point your client at the URL and send your own API key.
Connect
Get an API key from the Scrapingdog dashboard, then:
Claude Code
claude mcp add --transport http scrapingdog https://mcp.scrapingdog.com/mcp \
--header "Authorization: Bearer YOUR_API_KEY"
Cursor / Windsurf / any client with an `mcp.json`
{
"mcpServers": { "scrapingdog": { "url": "https://mcp.scrapingdog.com/mcp", "headers": { "Authorization": "Bearer YOUR_API_KEY" } } } }
claude.ai — Settings → Connectors → Add custom connector, URL https://mcp.scrapingdog.com/mcp, authentication "API key", paste your key.
Check it by hand
curl -s https://mcp.scrapingdog.com/mcp \
-H "Authorization: Bearer YOUR_API_KEY" \ -H "Content-Type: application/json" \ -H "Accept: application/json, text/event-stream" \ -d '{"jsonrpc":"2.0","id":1,"method":"tools/list"}'
Calls are billed to the key you send, at the same credit cost as the REST API. A tool's description states what it costs.
How it works
MCP client ──Authorization: Bearer <key>──> mcp.scrapingdog.com ──api_key=<key>──> api.scrapingdog.com
The server is stateless: every request builds its own MCP server and transport from the key on that request and tears them down with the response. One process serves many customers without a session map, so a key never outlives the request it came on and cannot leak into another caller's session. npm run smoke asserts exactly that, among other things.
Keys are verified against Scrapingdog's own /account endpoint (which resolves user keys and team member keys, and costs no credits), cached briefly. If that check is unreachable the request is let through, because the API itself still enforces the key on every tool call — an outage in the verifier must not take the whole MCP surface down. No database credentials are needed anywhere in this service.
Layout
| Path | What it is |
|---|---|
src/endpoints.ts | The 35 endpoints, declared. Adding an API means appending one object here — no handler code. |
src/server.ts | Builds the MCP server and derives each tool's schema from that registry |
src/client.ts | The HTTP client for api.scrapingdog.com |
src/auth.ts | API-key verification and caching |
src/http.ts | The hosted entry point (Streamable HTTP) |
src/index.ts | A stdio entry point, for local development only |
deploy/nginx/ | The mcp.scrapingdog.com vhost |
ecosystem.config.cjs | pm2 app definition |
scripts/smoke.mjs | Pre-deploy checks against a stubbed API |
Local development
npm ci
npm run build npm run smoke # stubs the API: no key needed, no credits spent
npm run dev # the HTTP server on http://127.0.0.1:8731/mcp SCRAPINGDOG_API_KEY=... npm run dev:stdio # stdio, for poking at one tool
Inspect it interactively:
npx @modelcontextprotocol/inspector
transport: Streamable HTTP, url: http://127.0.0.1:8731/mcp,
header: Authorization: Bearer
Settings live in .env.example.
Deploying
The server runs on its own box, separate from the API servers, so a problem here cannot affect api.scrapingdog.com.
First time, on a bare Ubuntu box:
git clone https://github.com/Darshan972/Scrapingdog-mcp.git ~/Scrapingdog-mcp
cd ~/Scrapingdog-mcp && bash deploy/setup-server.sh
That installs Node (from .nvmrc), pm2, nginx and the vhost, builds and starts the app, opens the firewall, and issues the TLS certificate — skipping the certificate with a clear message if DNS doesn't point here yet. It is safe to re-run.
After that, every push to main typechecks, builds, runs the smoke suite and only then rolls out with pm2 reload (.github/workflows/deploy.yml). Needs three repository secrets: MCP_SERVER_HOST, MCP_SERVER_USER, MCP_SSH_PRIVATE_KEY.
The deploy health check requires /healthz to answer 200 and an unauthenticated POST /mcp to answer 401, so a deploy that accidentally opened the gateway fails instead of going green.
The app binds 127.0.0.1 so nginx is the only route in. Don't change that on a public host: the key check lives in this process, so an exposed port is an open proxy to the API.
License
MIT