agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…

Name: agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…
Author: foomworks

by foomworksversion 0.2.1i★ 0iRuns in the cloud

Registry nameio.github.foomworks/agent-web

How to install

Overview

Description from the maker (original English)

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs in the cloud
Transport: Streamable HTTP
Category: Web & browsers

Install

Pick the AI app you use, then copy the settings.

Passed 4/4 checks · What you ask goes through the maker’s server (agent-web.foomworks.workers.dev)

First: which AI do you use?

ClaudeWeb · app · phoneChatGPTWebClaude CodeTerminalCursorCode editorVS CodeCode editorOtherOther apps

Pick your app and the steps appear below.

Works with Claude · about 2 min

No key, nothing to install · Set it up once on claude.ai or the desktop app, then use it in chat · free accounts can add 1

Open Claude’s Connectors page
CustomizeConnectors
Done
Click “+ Add” → “Add custom connector” and fill in these 2 fields
Copy each value into the field with the same name in Claude, then click Continue
Name · Nameagent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…
Remote MCP server URL · Addresshttps://agent-web.foomworks.workers.dev/mcp
Leave Authentication as Claude detected it, then click Add
Done
Turn it on in a chat
+Connectorsagent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…
Done
Try it
Use agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… and tell me what you can do for me, then show me one thing
✓ If Claude says it is using agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… or shows a agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with ChatGPT on business plans only

ChatGPT Business, Enterprise or Edu on the web, added by a workspace admin or owner · On Free, Plus or Pro: your ChatGPT plan cannot connect MCP yet

Open ChatGPT’s add-MCP page on the web
Plugins+Add custom MCP server
Done
Fill in the name and address
Enter a name, paste the address under Connection, tick the risk warning and click Create as a plugin
Name · Nameagent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…
Connection · Addresshttps://agent-web.foomworks.workers.dev/mcp
Done
Pick agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… in a chat
Start a new chat and pick agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… from your plugins before typing
Done
Try it
Use agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… and tell me what you can do for me, then show me one thing
✓ If ChatGPT says it is using agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… or shows a agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… tool in the answer, you are connected

Menu names checked against OpenAI’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Claude Code · about 2 min

No key, nothing to install

Open Terminal
Mac: press Command+Space and type Terminal · Windows: open PowerShell
Done

Paste this command and press Enter

claude mcp add --transport http agent-web https://agent-web.foomworks.workers.dev/mcp

Done

Type /mcp in Claude Code
You should see agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… listed as connected
Done
Try it
Use agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… and tell me what you can do for me, then show me one thing
✓ If Claude Code says it is using agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… or shows a agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… tool in the answer, you are connected

Menu names checked against Anthropic’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with Cursor · about 2 min

No key, nothing to install

Click this button to open Cursor
Open in Cursor
Cursor asks you to confirm; click Install
Done
Open the AI chat in Cursor in Agent mode
Done
Try it
Use agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… and tell me what you can do for me, then show me one thing
✓ If Cursor says it is using agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… or shows a agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… tool in the answer, you are connected

Menu names checked against Cursor’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Works with VS Code · about 2 min

No key, nothing to install

Click this button to open VS Code
Open in VS Code
VS Code asks you to confirm; click Install
Done
Open the AI chat in VS Code in Agent mode
Done
Try it
Use agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… and tell me what you can do for me, then show me one thing
✓ If VS Code says it is using agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… or shows a agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… tool in the answer, you are connected

Menu names checked against VS Code’s help page on Nov 11, 2026 · your screen may differ slightly by app version

Other apps that use MCP, such as Windsurf, Zed or Gemini CLI, each add servers differently. See how in the app list.

See every app that uses MCP →

Address for apps that connect over the web

Addresshttps://agent-web.foomworks.workers.dev/mcp

JSON settings are under “For developers” below

Stuck? Ask people who use agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…💬 Discussion →

For developers: Terminal commands and JSON settings

Over the web

Claude Code

claude mcp add --transport http agent-web https://agent-web.foomworks.workers.dev/mcp

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

VS Code (mcp.json)

{
  "servers": {
    "agent-web": {
      "type": "http",
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

At a glance

GitHub stars i: 0
Downloads per weeki: Not on npm/PyPI
Licence i: No licence stated
Connection: Runs in the cloud
Transport: streamable-http
Latest versioni: 0.2.1
Categoryi: Web & browsers
Published to registryi: Jun 23, 2026
Code last changedi: Jun 24, 2026
Maker: foomworks
Repo: foomworks/agent-web
Website: agent-web.foomworks.workers.dev
Registry status: Active

Which apps can use it

Based on how this server connects and on each app’s own docs, checked Nov 10, 2026.

Connect over the internet in

Claude ChatGPT Goose LM Studio Msty Studio Cherry Studio Cursor VS Code + GitHub Copilot Visual Studio Windsurf (Devin Desktop)Zed Kiro Cline Continue JetBrains AI Assistant Claude Code Codex CLI Gemini CLI OpenCode nodecode Warp LibreChat Open WebUI Raycast

All apps, with pros and cons →

What it can do

Tool names and descriptions exactly as the server reported them on Nov 11, 2026. The maker wrote them, not us; we show them as plain text.

read_url
Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text
read_url_preview
Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.
render_preview
Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.
render_screenshot
PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
render_pdf
PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 11, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account foomworks, which owns the repo
✓ Pass
Still maintained
Code last changed 5 months ago
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
✓ Pass
Endpoint responds
Responded in 148 ms (HTTP 200)
– Not applicable
Sign-in with OAuth
No sign-in needed
✓ Pass
No hidden instructions in tool descriptions
Read 5 tool descriptions and found no hidden instructions to the AI

Discussion

Ask, share a tip or report that it does not work. Sorted by what people marked helpful.

No posts yet. Be the first to ask or share.

Posts here are written by users, not the PopNx team.

User reviews

No reviews yet

Compared with others in Web & browsersi

More stars than 0% of the other 1466 servers in this category
Published to the registry more recently than 12% of the other 1466 servers in this category
Basic checks equal to or better than 100% of the other 1466 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… safe?

It passed 4 of 4 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.

Is it still maintained?

The GitHub repo last changed 5 months ago, and the latest version (0.2.1) reached the registry 5 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT Business and above.

What can I use instead?

In the same category: Browser Use, Scrapling MCP Server, Chrome DevTools MCP

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:↓ Downloads per weeki★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Browser Use

Lets AI do web tasks for you, such as filling forms, searching and extracting data, in the maker’s cloud browsers or on your computer.

by browser-useWidely used↓ 1.7M/wk★ 120.6KUpdated 22 days ago

Computer or cloud✓ browser-use.com

Install

Scrapling MCP Server

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

by D4VinciWidely used↓ 396.9K/wk★ 101.2KUpdated 7 days ago

Runs on your computer

Install

Chrome DevTools MCP

Lets AI use Chrome’s developer tools to inspect pages, find what makes them slow and spot errors. Made by the Chrome DevTools team.

by ChromeDevToolsWidely used↓ 1.9M/wk★ 55.1KUpdated today

Runs on your computer

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

agent-web

URL → LLM-ready markdown. A charter-clean, *polite, robots-respecting* web reader for AI agents — honors robots.txt, identifies honestly, and never bypasses anti-bot/CAPTCHA or paywalls. No account, no API key — free per-call access.

🌐 Live: https://agent-web.foomworks.workers.dev · 🔌 MCP: `https://agent-web.foomworks.workers.dev/mcp`

What it gives an agent

Give it one publicly reachable URL; get back the page as clean, LLM-ready markdown — title, word count, and the text — without parsing raw HTML yourself. Server-rendered (static) HTML pages. Ideal for summarizing an article, extracting docs, or feeding a page into an LLM.

Connect as an MCP server (recommended)

Streamable HTTP, JSON-RPC 2.0:

https://agent-web.foomworks.workers.dev/mcp

Tool	Cost	Returns
`read_url`	free	fetch a URL → full LLM-ready markdown (title, word count, markdown)
`read_url_preview`	free	the first ~600 characters of the markdown — a cheap look before the full pull

Or call it over HTTP

BASE=https://agent-web.foomworks.workers.dev

curl -s "$BASE/read?url=https://example.com/&ref=readme" # full markdown curl -s "$BASE/read/preview?url=https://example.com/&ref=readme" # first ~600 chars

Discovery: /.well-known/mcp.json (MCP) · /.well-known/agent-card.json (A2A) · /openapi.json · /policy (Acceptable-Use Policy)

Charter-clean by design (the bright line)

This is a *polite* reader, not a scraper:

Honors the origin's robots.txt for our user-agent — a disallowed path is refused without fetching; an unconfirmable robots.txt (5xx/error) is treated conservatively as disallowed.
Identifies honestly with a descriptive user-agent — never spoofs a browser.
Read-only GET of the single URL you supply — no crawl, no proxy rotation.
Never bypasses anti-bot/CAPTCHA, paywalls, or login walls.
SSRF-guarded: private/loopback/link-local/internal hosts are blocked and every redirect hop is re-validated.

You are responsible for your right to fetch the URL you submit.

Limits

Static HTML only for now — JavaScript-rendered pages, screenshots, and PDF are a later increment.
Body cap ~2 MB, fetch timeout ~12 s.
The service holds no keys and never initiates payments.

Install the AgentSkill

SKILL.md is a portable AgentSkill (ClawHub / skills.sh / Claude Skills).

About

agent-web is operated by FOOM — an AI-operated, human-supervised autonomous service. License: MIT.

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea…

Overview

What you can do with it

Install

Open Claude’s Connectors page

Click “+ Add” → “Add custom connector” and fill in these 2 fields

Turn it on in a chat

Try it

Open ChatGPT’s add-MCP page on the web

Fill in the name and address

Pick agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page rea… in a chat

Try it

Open Terminal

Paste this command and press Enter

Type /mcp in Claude Code

Try it

Click this button to open Cursor

Open the AI chat in Cursor in Agent mode

Try it

Click this button to open VS Code

Open the AI chat in VS Code in Agent mode

Try it

Over the web

At a glance

Which apps can use it

Related guides

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Discussion

User reviews

Compared with others in Web & browsersi

Common questions

Alternatives

Browser Use

Scrapling MCP Server

Chrome DevTools MCP

README from the maker

agent-web

What it gives an agent

Connect as an MCP server (recommended)

Or call it over HTTP

Charter-clean by design (the bright line)

Limits

Install the AgentSkill

About