Prototype · Preview: every server in the official registry, synced every 30 minutes. Reviews and accounts come in a later step.
PopNx MCPMCP servers for people who use AI · explained in plain words

ScrapingBot

by mike-scrapingbotversion 1.0.0i★ 0iRuns in the cloud
Registry nameio.scrapingbot/scrapingbot

Install

Overview

Description from the maker (original English)

Public web data for AI agents: scrape any page, plus Google, TikTok, Instagram and Amazon as JSON.

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

  • Connection: Runs in the cloud
  • Transport: Streamable HTTP
  • Category: Marketing & social media
  • You need to fill in: x-api-key

Install

Pick the AI app you use, then copy the settings.

Before you install

Values marked secret are keys to your account. Never share them or paste them into a chat.

You need

Which app do you use?

Pick your app above. We remember it, so next time the button says “Install in …”.

This address needs a key in a request header, which the add-connector menu cannot set. Use Claude Code, Cursor or VS Code instead.

Run this in your terminal

claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcp --header 'x-api-key: your-value'

Fill in the empty values before running it.

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "scrapingbot": {
      "url": "https://scrapingbot.io/api/mcp",
      "headers": {
        "x-api-key": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "scrapingbot": {
      "type": "http",
      "url": "https://scrapingbot.io/api/mcp",
      "headers": {
        "x-api-key": "your-value"
      }
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

This address needs a key in a request header, which the add-connector menu cannot set. Use Claude Code, Cursor or VS Code instead.

Your choice stays on this device in a cookie; no account needed.

Values you fill in

  • x-api-key secret required HTTP header
    Your ScrapingBot API key, from https://scrapingbot.io/dashboard/api-keys (100 free credits on sign-up).

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Connect over the internet in

ClaudeChatGPTGooseLM StudioMsty StudioCherry StudioCursorVS Code + GitHub CopilotVisual StudioWindsurf (Devin Desktop)ZedKiroClineContinueJetBrains AI AssistantClaude CodeCodex CLIGemini CLIOpenCodenodecodeWarpLibreChatOpen WebUIRaycast

All apps, with pros and cons →

Related guides

What it can do

Tool names and descriptions exactly as the server reported them on Nov 8, 2026. The maker wrote them, not us; we show them as plain text.

  • listCapabilities

    List every ScrapingBot tool, the API routes behind them and their parameters. Free.

  • scrapeWebsite

    Fetch any public web page and return its content as markdown (format: "html" for the raw HTML). 1 credit; render_js (pages built with JavaScript) 5; premium_proxy 10; stealth_proxy 75. screenshot: true attaches a screenshot image.

  • extractStructuredData

    Fetch a web page and have AI pull out exactly the fields you want, as JSON. Pass ai_query (plain English, e.g. "title, price and stock") or ai_schema ({"field": "description"}). The page cost plus 5 credits.

  • getScrapeJob

    Look up an earlier scrape by the job_id it returned. Free.

  • pollJobUntilDone

    Wait for a scrape job to finish, then return it. Free.

  • runBrowserScenario

    Open a page in a real browser, run steps such as click, fill, scroll and wait, then return the resulting page as markdown. js_scenario: {"instructions": [{"fill": ["#q", "shoes"]}, {"click": "#go"}, {"wait": 1000}]}. From 5 credits.

  • googleSearch

    Google results as JSON: web (default), images, videos, news, shopping, places or maps (type), for any country (gl) and language (hl). Places and maps results include a cid for googleReviews. 10 credits.

  • googleReviews

    Reviews of a place from Google Maps, by the cid, fid or placeId in a googleSearch places or maps result. sortBy newest, mostRelevant, highestRating or lowestRating; pass nextPageToken for more. 10 credits.

  • instagramUser

    An Instagram profile: bio, follower, following and post counts, links and the numeric user id other tools need. Pass one of username, user_id or url. 5 credits.

  • instagramSearch

    Search Instagram accounts, hashtags, places or posts (search_type), or everything at once (global). 5 credits.

  • instagramMedia

    Instagram content by mode: an account's posts, reels or tagged posts (user_id), one post by shortcode or url, a post's comments, the replies to a comment (comment_id), or an account's active stories (username). 5 credits.

  • instagramFollowers

    List or search an Instagram account's followers or following, by numeric user_id from instagramUser. query searches the whole list; max_id pages. For very large accounts Instagram shows only about 50 recent followers, so use query to find someone. 5 credits.

  • tiktokVideo

    A TikTok video's stats, caption, author, sound and download links, by video URL. 1 credit.

  • tiktokUser

    A TikTok profile by username: bio, counts, verified badge and numeric user id; include_posts returns the latest videos instead. 1 credit.

  • tiktokSearch

    Search TikTok creators (search_type: users) or videos (videos) by keyword. Videos page: for page 2 onward pass the previous response's data.cursor as cursor and its data.searchId as search_id. Users search returns a single page and ignores cursor. 1 credit.

  • tiktokComments

    Comments on a TikTok video (url), or the replies to one comment (comment_id plus the video url or video_id). 1 credit.

  • tiktokFollowers

    A TikTok account's followers or the accounts it follows, by numeric user_id (data.user.id from tiktokUser). Up to 50. 1 credit.

  • amazonSearch

    Search Amazon US products by keyword: title, price, rating, Prime and photo for each. page for more. 10 credits.

  • amazonProduct

    Everything on an Amazon product page by ASIN: price, rating, availability, bullet points, specifications, photos and variations. 10 credits.

  • amazonProducts

    Full details for up to 20 ASINs in one call, the same as amazonProduct for each. 10 credits per product returned; ASINs that fail are free.

  • amazonSuggestions

    The suggestions Amazon shows as a shopper types: useful for keyword research. 10 credits.

  • amazonRankings

    Amazon's Best Sellers or New Releases for a department, in rank order, with price and rating. 10 credits.

  • providerRequest

    Call any Google, Instagram, TikTok or Amazon endpoint by path, for the few the other tools do not cover (listCapabilities lists them). Costs the same as that API.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 11, 2026

  • ✓ Pass

    Maker matches the repo

    The registry name was verified against the domain scrapingbot.io (the registry checks domain ownership)

  • ✓ Pass

    Still maintained

    Code last changed 38 days ago

  • … Not checked yet

    Has a licence

    We have not read this repo from GitHub yet

  • ✓ Pass

    Endpoint responds

    Responded in 591 ms (HTTP 200)

  • – Not applicable

    Sign-in with OAuth

    No sign-in needed

  • ✓ Pass

    No hidden instructions in tool descriptions

    Read 23 tool descriptions and found no hidden instructions to the AI

Compared with others in Marketing & social mediai

  • More stars than 0% of the other 3758 servers in this category
  • Published to the registry more recently than 43% of the other 3758 servers in this category
  • Basic checks equal to or better than 100% of the other 3758 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is ScrapingBot safe?

It passed 4 of 4 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

You need to fill in: x-api-key

Does it run on my computer or in the cloud?

It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.

Is it still maintained?

The GitHub repo last changed 38 days ago, and the latest version (1.0.0) reached the registry 38 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT in developer mode.

What can I use instead?

In the same category: PostHog MCP Server, Agent-Native Analytics, Openshorts

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

PostHog MCP Server

Official PostHog MCP Server for product analytics, feature flags, experiments, and more.

by PostHogWidely used★ 40.7KUpdated 10 months ago

Runs in the cloud

Agent-Native Analytics

Agent-Native Amplitude/Mixpanel - connect data sources, prompt for charts

by BuilderIOWidely used★ 7.7KUpdated 2 months ago

Runs in the cloud

Openshorts

Turn long videos into viral vertical shorts and publish them to TikTok, Instagram and YouTube.

by mutonbyWidely used★ 7.6KUpdated 3 months ago

Runs in the cloud

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

ScrapingBot

One API key for public web data: scrape any page (plain or JavaScript-rendered), pull fields out with AI, and get public TikTok, Instagram, Google and Amazon data as JSON. A hosted MCP server gives AI agents the same data as tools.

100 free credits when you sign up. No credit card. Get your API key

Docs · Pricing · MCP server · Examples · Agent Skills


Quickstart

export SCRAPINGBOT_API_KEY="YOUR_API_KEY"

curl "https://scrapingbot.io/api/v1/scrape?url=https://example.com" \ -H "x-api-key: $SCRAPINGBOT_API_KEY"

{

"success": true, "url": "https://example.com", "html": "<!doctype html> …", "status": 200, "duration": "0.79", "credits_used": 1, "job_id": "…" }

That call cost 1 credit. Failed requests are refunded automatically.

Base URL: https://scrapingbot.io/api/v1 Auth: x-api-key: YOUR_API_KEY header (or Authorization: Bearer YOUR_API_KEY). Keep the key on the server.

Endpoints

The data APIs (TikTok, Instagram, Google, Amazon) are all POST with a JSON body naming the endpoint and its params:

curl -X POST "https://scrapingbot.io/api/v1/tiktok" \

-H "x-api-key: $SCRAPINGBOT_API_KEY" \ -H "Content-Type: application/json" \ -d '{"endpoint": "/user/info", "params": {"unique_id": "tiktok"}}'

APIRouteendpoint valuesCredits
WebsiteGET or POST /api/v1/scrapeone route; options: render_js, screenshot, js_scenario, wait_for, premium_proxy, stealth_proxy, …1 plain · 5 rendered · 10 premium proxy · 75 stealth proxy
AI extraction/api/v1/scrape + ai_query or ai_schemareturns ai_result JSON+5 on top of the page
Job lookupGET /api/v1/job/:job_idre-fetch a scrape result (kept 24 hours)free
TikTokPOST /api/v1/tiktok/ (video), /user/info, /user/posts, /user/followers, /user/following, /user/search, /feed/search, /music/info, /music/posts, /comment/list, /comment/reply1
InstagramPOST /api/v1/instagram/user/by_username, /user/by_id, /medias/by_user_id, /reels/by_user_id, /medias/tagged_by_user_id, /stories/by_username, /followers/by_user_id, /following/by_user_id, /media/by_shortcode, /media/by_url, /comments/media_comments_by_id, /comments/replies, /search/users_by_keyword, /search/hashtags_by_keyword, /search/places_by_keyword, /search/global, /search/posts, /media/shortcode_to_id, /media/id_to_shortcode5
GooglePOST /api/v1/google/search, /images, /videos, /news, /shopping, /places, /maps, /reviews10
AmazonPOST /api/v1/amazon/search, /product-details, /products (up to 20 ASINs), /autocomplete, /best-sellers, /new-releases, /product-category-list, /deals-v2, /seller-profile, /seller-products10 (/products: 10 per product returned)
ChatGPTPOST /api/v1/chatgptbody {"prompt": "…"}10
MCPPOST /api/mcp23 tools over Streamable HTTPsame as the API behind each tool

Full parameters and response shapes: docs.

How charging works
  • Data APIs charge only for a successful 200. Any error is refunded.
  • Website API charges when the page answers (2xx/3xx, or a real 400/404 from the site, reported as fault: "user"). Timeouts, other 4xx such as 403 and 429, 5xx and errors on our side are refunded (credits_used: 0).
  • Requests rejected before they run (missing parameter, bad key, concurrency limit) cost nothing.
Limits

Limits are on requests in flight at once, not per minute. The free plan allows 1 concurrent request; paid plans allow 10 to 200. Going over returns 429 right away (free); retry with a short, growing delay. Timeouts: 45 s for scraping and Instagram, 30 s for TikTok and Amazon, 15 s for Google.

StatusMeaningCharged
400Missing or invalid parameter, unsupported endpointNo (except a target page's own 400 on the Website API)
401Missing or invalid API keyNo
402Not enough credits; the message says how many are neededNo
404Website API: the page doesn't exist. Data APIs: profile, post or product not foundWebsite API only
408Timed outNo
429Concurrency limit reachedNo
5xxThe site or a data source failedNo

MCP server for AI agents

Hosted at `https://scrapingbot.io/api/mcp` (Streamable HTTP, stateless). Nothing to install. Authenticate with your API key in the x-api-key header, or Authorization: Bearer.

Claude Code
claude mcp add --transport http scrapingbot https://scrapingbot.io/api/mcp \

--header "x-api-key: YOUR_API_KEY"

Add --scope user to use it in every project. Type /mcp in a session to see the tools.

Claude Desktop (and Claude on the web)

Open Settings → Connectors → Add custom connector, name it ScrapingBot, and paste:

https://scrapingbot.io/api/mcp?api_key=YOUR_API_KEY

Then turn it on from the tools menu in a chat. Connectors take a URL only, so the key goes in the URL: keep that URL private, like a password.

Cursor

~/.cursor/mcp.json (or .cursor/mcp.json in a project):

{

"mcpServers": { "scrapingbot": { "url": "https://scrapingbot.io/api/mcp", "headers": { "x-api-key": "YOUR_API_KEY" } } } }

VS Code

.vscode/mcp.json in your project, then pick the ScrapingBot tools in Copilot's agent mode:

{

"servers": { "scrapingbot": { "type": "http", "url": "https://scrapingbot.io/api/mcp", "headers": { "x-api-key": "YOUR_API_KEY" } } } }

Any other MCP client

URL https://scrapingbot.io/api/mcp, header x-api-key: YOUR_API_KEY (or Authorization: Bearer YOUR_API_KEY). If the client only takes a URL, append ?api_key=YOUR_API_KEY. When calling it by hand, send Accept: application/json, text/event-stream.

Tools
AreaToolsCredits
Any websitescrapeWebsite (markdown or HTML, optional screenshot), extractStructuredData (AI fields as JSON), runBrowserScenario (click, fill, scroll, wait)1 / 5 rendered; +5 for AI
GooglegoogleSearch (web, images, videos, news, shopping, places, maps), googleReviews10
InstagraminstagramUser, instagramSearch, instagramMedia, instagramFollowers5
TikToktiktokVideo, tiktokUser, tiktokSearch, tiktokComments, tiktokFollowers1
AmazonamazonSearch, amazonProduct, amazonProducts, amazonSuggestions, amazonRankings10
UtilitylistCapabilities, getScrapeJob, pollJobUntilDone (free), providerRequest (any endpoint above)

Tool calls are ordinary API requests: same credits, same concurrency slots, same refunds.

Agent Skills

skills/ holds Agent Skills that teach an agent to call the REST API directly with SCRAPINGBOT_API_KEY: which endpoint for which task, the parameters, the response fields worth reading, error handling and costs.

SkillUse it for
web-scrapingFetching any page, rendering JavaScript, browser actions, screenshots, AI extraction
google-searchGoogle web, images, videos, news, shopping, places, maps and reviews
tiktok-dataPublic TikTok videos, profiles, posts, sounds, comments and search
instagram-dataPublic Instagram profiles, posts, reels, comments and search
amazon-productsAmazon search, product details, batches, rankings, suggestions and deals

Claude Code: copy a folder into ~/.claude/skills/ (or .claude/skills/ in a project). Set SCRAPINGBOT_API_KEY in the environment the agent runs in.

Examples

Small, runnable scripts in examples/, each in curl, Python (requests) and Node (built-in fetch, Node 18+):

Python needs pip install requests; the curl scripts that build JSON use jq. Each language folder has a tiny shared client (scrapingbot.py, scrapingbot.mjs) that retries refunded failures (408, 429, 5xx) with backoff.

export SCRAPINGBOT_API_KEY="YOUR_API_KEY"

sh examples/curl/scrape.sh https://example.com python examples/python/google_search.py "best espresso machine" node examples/node/tiktok_user.mjs tiktok

Pricing

Free: 100 credits on sign-up, 1 concurrent request. Paid plans start at $49.99/month for 275,000 credits and 10 concurrent requests. See pricing.

Responsible use

ScrapingBot returns publicly available data. Respect each site's terms and applicable law, and handle any personal data you collect accordingly.

License

The examples and skills in this repository are MIT licensed. See LICENSE. Use of the ScrapingBot API is subject to the terms at scrapingbot.io.