Scrawly MCP Server

Name: Scrawly MCP Server
Author: IliasSami

by IliasSamiversion 1.0.0i★ –iRuns on your computer

Registry nameio.github.IliasSami/scrawly

Install

Overview

Description from the maker (original English)

MCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes.

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

User voiceiNo reviews yetReviews open together with accounts in a later step
Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
UsageiNot measured yet★ –

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs on your computer
Transport: stdio
Category: Marketing & social media

Install

Pick the AI app you use, then copy the settings.

Before you install

Basic checks: 1 of 1 passed
Runs on your computer with your user’s permissions (files, network, apps).
The registry lists no key to fill in.

You need

PyPIPython’s uv installed (for the uvx command)

Which app do you use?

ClaudeClaude CodeCursorVS CodeChatGPT

Pick your app above. We remember it, so next time the button says “Install in …”.

Open Claude Desktop → Settings → Developer → Edit Config, and paste this into claude_desktop_config.json

{
  "mcpServers": {
    "scrawly": {
      "command": "uvx",
      "args": [
        "sentinelseo"
      ]
    }
  }
}

Run this in your terminal

claude mcp add scrawly -- uvx sentinelseo

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "scrawly": {
      "command": "uvx",
      "args": [
        "sentinelseo"
      ]
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "scrawly": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "sentinelseo"
      ]
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

This one runs on your computer, and ChatGPT can only connect to servers on the internet. Pick another app.

Your choice stays on this device in a cookie; no account needed.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

What it can do

Runs on your computer; the tool list appears in your AI app after you install it.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 7, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account IliasSami, which owns the repo
… Not checked yet
Still maintained
We have not read this repo from GitHub yet
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
– Not applicable
Endpoint responds
This one runs on your computer; there is no internet endpoint
– Not applicable
Sign-in with OAuth
Runs on your computer and uses local settings instead
… Not checked yet
No hidden instructions in tool descriptions
Runs on your computer; we can only read tool lists from internet endpoints

Compared with others in Marketing & social mediai

More stars than 0% of the other 2985 servers in this category
Published to the registry more recently than 50% of the other 2985 servers in this category
Basic checks equal to or better than 100% of the other 2985 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is Scrawly MCP Server safe?

It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs on your computer. Your AI app starts it when needed, and data does not pass through the maker’s servers (unless it calls an online service itself).

Is it still maintained?

The GitHub repo last changed –, and the latest version (1.0.0) reached the registry 30 days ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. You also need Python (uv) on your computer.

What can I use instead?

In the same category: MCP YouTube Transcript, Google Analytics MCP, BibiGPT YouTube Video Summarizer

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

MCP YouTube Transcript

by jkawamoto

An MCP server retrieving transcripts of YouTube videos

Runs on your computer★ 495MITUpdated 10 days ago

Install

Google Analytics MCP

by surendranb

GA4 MCP server for AI agents: schema discovery, server-side aggregation, analysis-ready defaults.

Runs on your computer★ 244MITUpdated 10 days ago

Install

BibiGPT YouTube Video Summarizer

by JimmyLv

AI video summarizer: summarize and transcribe YouTube, Bilibili, TikTok and podcast videos.

Runs in the cloud★ 137MITUpdated 10 days ago

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

Scrawly: the free, open-source SEO crawler and site audit tool

Free technical SEO, GEO and AI-search audits for any website.

A free alternative to Screaming Frog and Sitebulb. No account, no page cap, no subscription.

Scrawly is a free, open-source desktop SEO crawler and technical site audit tool for macOS, Windows and Linux. It crawls a website, runs 250 technical SEO, GEO (Generative Engine Optimization) and agentic-web checks on every page, maps the site's architecture, and explains in plain language what to fix. For WordPress sites it can also apply safe, reversible fixes. Scrawly is created by [Ilias Sami](https://iliassami.com/) and released for the SEO community under the MIT License.

In one sentence: Scrawly is a free desktop app that audits any website for the

technical issues that affect Google rankings and AI-search visibility (ChatGPT,

Perplexity, Google AI Overviews), with no account and no page limit.

Official Portals & Network:

🌐 Official Website: iliassami.com/scrawly
☁️ Google Sites Hub: sites.google.com/view/scrawly-seo-crawler/home
⚡ Cloudflare Edge Node: iliassami-seo-cloudstack.pages.dev/scrawly-desktop-seo-crawler
📦 GitHub Pages: iliassami.github.io/scrawly-seo-crawler

Install in one line
What Scrawly checks
Free alternative to Screaming Frog and Sitebulb
GEO and AEO: auditing for AI search
Fix WordPress issues safely
Privacy
FAQ
Documentation · Contributing · License

Install in one line

Scrawly installs itself, adds an app icon (Applications on macOS, the Start Menu on Windows, your app menu on Linux), and keeps itself up to date.

macOS or Linux (Terminal):

curl -fsSL https://raw.githubusercontent.com/IliasSami/scrawly-seo-crawler/main/install.sh | bash

Windows (PowerShell):

irm https://raw.githubusercontent.com/IliasSami/scrawly-seo-crawler/main/install.ps1 | iex

Then open Scrawly like any other app. There is nothing to sign up for.

Prefer to install by hand?

You need Python 3.11 or newer and git. (Node.js is not needed: releases ship the interface prebuilt.)

git clone https://github.com/IliasSami/scrawly-seo-crawler.git Scrawly

cd Scrawly python3 scripts/install.py # Windows: py scripts\install.py

The installer creates a private Python environment, downloads the crawler browser (about 150 MB, once), and adds Scrawly to your apps. Full guide, Linux notes and troubleshooting: [docs/DESKTOP.md](docs/DESKTOP.md).

What Scrawly checks

Scrawly runs 250 checks grouped into 23 areas. Every finding comes with why it matters, how to fix it, and the exact pages affected.

Area	Examples
Crawlability and indexability	robots.txt rules, meta robots and `X-Robots-Tag`, noindex conflicts, orphan pages, crawl depth
Response codes and redirects	4xx and 5xx pages, redirect chains and loops, temporary vs permanent redirects
Titles, meta and headings	missing, duplicate, too long or too short titles; pixel-width truncation; meta descriptions too thin for AI; H1 and heading order
Canonicalization	missing, conflicting, cross-domain or non-indexable canonicals
Content quality	thin and duplicate content, near-duplicates, readability
Structured data	JSON-LD, Microdata and RDFa, with schema validation
Internal linking and architecture	link graph, internal PageRank ("authority"), broken links, generic anchors
Performance and Core Web Vitals	PageSpeed Insights lab and field (CrUX) data, TTFB, page weight
AI search readiness (GEO)	which AI crawlers you allow or block, `llms.txt`, AI citation readiness
Agentic web	how well AI agents can read and operate your site
And more	images and alt text, hreflang, XML sitemaps, security and TLS, mobile, JavaScript rendering, pagination, WordPress specifics

The full catalogue, with severity and fix tier for every check, is in docs/CHECK_MANIFEST.yaml.

Also included: JavaScript rendering, custom extraction, saved crawl profiles, a 3D site graph and depth tree, crawl-to-crawl comparison, scheduled audits with regression alerts, Google Search Console and GA4 data, branded HTML and PDF reports, an AI writer for titles and meta descriptions (bring your own AI key), and an MCP server so AI assistants can work with your audits (docs/MCP.md).

A free alternative to Screaming Frog and Sitebulb

Screaming Frog SEO Spider and Sitebulb are excellent tools. Scrawly is a free, open-source option for people who want a deep technical audit without a licence, plus checks for AI search.

	Screaming Frog / Sitebulb	Scrawly
Price	Paid licence or subscription (limited free tier or trial)	Free and open-source (MIT)
Account or licence key	Needed for full use	None
Page limit	The free tier is capped	No cap: you set the limit
AI search (GEO) and agentic-web checks	Some, depending on version	A dedicated set: AI crawler access, `llms.txt`, citation and agent readiness
Fixes	Report only	Safe, reversible fixes on WordPress
Source code	Closed	Open: read, audit, contribute

Scrawly is independent and not affiliated with Screaming Frog Ltd or Sitebulb.

GEO and AEO: auditing for AI search

Search now includes AI answer engines that read your pages and decide whether to cite you. Scrawly audits for Generative Engine Optimization (GEO) and Answer Engine Optimization (AEO):

AI crawler access: a matrix of which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot and others) your robots.txt and firewall allow or block.
`llms.txt`: whether you publish a curated index for AI systems, and its quality.
Meta as AI context: a description is often the first thing an AI reads about a page, so Scrawly flags descriptions too thin to understand and can draft an entity-rich one from the page's own content.
Entities and structured data: the schema and named entities that help search engines and AI understand what a page is about.

Four-Step Agency Audit Workflow

Target URL Input: Configure depth, concurrency, user-agents, and custom robots rules.
Automated Heuristic Scan: Dual-pass HTTP inspection and headless Chromium JavaScript rendering.
Interactive Visual Dashboard: Prioritized issue triaging by impact score and crawl depth.
Client-Ready Deliverables: Instant export to white-label PDF, Excel/CSV, and portable SQLite databases.

Fix WordPress issues safely

Connect a WordPress site with the lightweight Scrawly Connector plugin and Scrawly can fix titles, meta descriptions, canonicals and redirects for you:

a rollback snapshot is saved before every change, and every fix can be undone;
changes to the live site always ask for your confirmation first;
higher-risk issues are never auto-applied; they're flagged for a person to review.

See docs/WORDPRESS_CONNECTOR.md. Every other site (Shopify, Wix, Webflow, Next.js, custom) gets the full read-only audit.

Privacy: your audits stay on your computer

Scrawly has no accounts and no analytics. Your crawls, findings and reports are stored on your computer only. Scrawly connects to:

the websites you choose to audit;
GitHub, to check for updates (turn off with SCRAWLY_AUTO_UPDATE=0);
services you configure, such as PageSpeed Insights, Google Search Console or your AI provider;
the feedback service, only when you click Send on a feedback note.

The app's local engine only accepts requests from the Scrawly window itself, so other websites can't use it. Report security issues as described in SECURITY.md.

Frequently asked questions

What is Scrawly? Scrawly is a free, open-source SEO crawler and technical site audit tool that runs as a desktop app on macOS, Windows and Linux. It checks every page of a website for 250 technical SEO, GEO and agentic-web issues and explains how to fix them.

Is there a free alternative to Screaming Frog? Yes. Scrawly is a free, open-source alternative to Screaming Frog SEO Spider and Sitebulb. It has no page cap and no licence, and it adds AI-search (GEO) checks and safe WordPress fixes.

Is Scrawly really free? Yes. Scrawly is free and open-source under the MIT License, with no account, subscription or usage limit. Audits run on your own computer, so there is no per-crawl cost.

Do I need to create an account? No. Install it and start auditing. There is no sign-up, login or approval.

Does Scrawly work on websites that aren't WordPress? Yes. The audit works on any website. Only the one-click fixes are WordPress-specific.

Can Scrawly check AI search and GEO readiness? Yes. It checks AI crawler access, llms.txt, whether titles and descriptions give AI enough context, structured data, and how well AI agents can use the site.

How many pages can Scrawly crawl? There is no fixed cap. You choose the limit per audit; how far you can go depends on your computer and the website.

Who made Scrawly? Scrawly was created by Ilias Sami, an SEO consultant, as a free contribution to the SEO community. Contact: me@iliassami.com.

Documentation

docs/DESKTOP.md: install, update, Linux notes and troubleshooting
docs/WORDPRESS_CONNECTOR.md: the WordPress fix plugin
docs/MCP.md: use your audits from AI assistants (MCP)
[docs/CHECK_MANIFEST.yaml](docs/

Only the beginning is shown; read the rest in the repo

Scrawly MCP Server

Overview

PopNx MCP’s three pillars

What you can do with it

Install

Before you install

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Compared with others in Marketing & social mediai

Common questions

Alternatives

MCP YouTube Transcript

Google Analytics MCP

BibiGPT YouTube Video Summarizer

README from the maker

Contents

Install in one line

What Scrawly checks

A free alternative to Screaming Frog and Sitebulb

GEO and AEO: auditing for AI search

Four-Step Agency Audit Workflow

Fix WordPress issues safely

Privacy: your audits stay on your computer

Frequently asked questions

Documentation