llms.txt for agents

Name: llms.txt for agents
Author: ux-xd

by ux-xdversion 0.1.1i★ –iRuns in the cloud

Registry nameio.github.ux-xd/llms-txt

Install

Overview

Description from the maker (original English)

Any site's llms.txt: find the covering index, read its linked docs as markdown, search sections.

PopNx MCP’s three pillars

These three are never merged into one score: opinions, measurements and popularity are different things.

User voiceiNo reviews yetReviews open together with accounts in a later step
Our basic checksi1 of 1 passedChecked from public information; code not scanned yet
UsageiNot measured yet★ –

What you can do with it

We have not written a plain-language summary for this one yet. Below are the facts we read from the registry.

Connection: Runs in the cloud
Transport: Streamable HTTP
Category: Search & AI memory

Install

Pick the AI app you use, then copy the settings.

Before you install

Basic checks: 1 of 1 passed
Runs on the maker’s server: what you ask it goes through their server.
The registry lists no key to fill in.

You need

Runs in the cloudNothing to install; it connects over the internet

Which app do you use?

ClaudeClaude CodeCursorVS CodeChatGPT

Pick your app above. We remember it, so next time the button says “Install in …”.

Works in Claude on the web, desktop and mobile:

Open Settings → Connectors
Press Add custom connector
Paste the address below and press Add
If it asks you to sign in, sign in with the maker

https://llmstxtmcp.dev/mcp

Run this in your terminal

claude mcp add --transport http llms-txt https://llmstxtmcp.dev/mcp

Open in Cursor

Or copy the settings yourself

Paste into .cursor/mcp.json in your project, or ~/.cursor/mcp.json

{
  "mcpServers": {
    "llms-txt": {
      "url": "https://llmstxtmcp.dev/mcp"
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

Open in VS Code

Or copy the settings yourself

Paste into .vscode/mcp.json in your project

{
  "servers": {
    "llms-txt": {
      "type": "http",
      "url": "https://llmstxtmcp.dev/mcp"
    }
  }
}

Your browser asks to open the app, then the app shows the settings and asks you to confirm. Key values are left empty for you to fill in.

ChatGPT connects only to servers on the internet:

Open ChatGPT on the web → Settings → Connectors (Apps)
Press Create or Add (some plans need Developer mode under Advanced first)
Paste the address below, give it a name and save
If it asks you to sign in, sign in with the maker

https://llmstxtmcp.dev/mcp

Menu names can differ slightly by plan and over time.

Your choice stays on this device in a cookie; no account needed.

These settings are generated from the maker’s registry entry. If the README says otherwise, follow the README.

What it can do

We have not read this server’s tool list yet; we check endpoints in rotation.

Basic checksi

We check information anyone can see; we have not read the code. Checks that do not apply are left out of the count. · Checked Nov 8, 2026

✓ Pass
Maker matches the repo
The registry name was verified with the GitHub account ux-xd, which owns the repo
… Not checked yet
Still maintained
We have not read this repo from GitHub yet
… Not checked yet
Has a licence
We have not read this repo from GitHub yet
… Not checked yet
Endpoint responds
Not checked yet; we check endpoints in rotation
… Not checked yet
Sign-in with OAuth
Not checked yet; we check endpoints in rotation
… Not checked yet
No hidden instructions in tool descriptions
Not checked yet; we read the tool list when we check the endpoint

Compared with others in Search & AI memoryi

More stars than 0% of the other 5670 servers in this category
Published to the registry more recently than 37% of the other 5670 servers in this category
Basic checks equal to or better than 100% of the other 5670 servers in this category

Compared with every active server in this category in the registry. Stars count only when the publisher owns the repo.

Common questions

Is llms.txt for agents safe?

It passed 1 of 1 applicable basic checks. We have not read the code. Before adding a key or token, see what access the server asks for and use a key with only the permissions you need.

What keys or codes does it need?

The registry does not list a required key, though some servers ask you to sign in on first use.

Does it run on my computer or in the cloud?

It runs in the maker’s cloud. Connect over the internet with nothing to install, but what you send passes through the maker’s servers.

Is it still maintained?

The GitHub repo last changed –, and the latest version (0.1.1) reached the registry 2 months ago.

Which apps can use it?

Apps that support MCP, such as Claude Desktop, Claude Code, Cursor and VS Code. It connects by URL, so apps that accept remote MCP servers work too, such as ChatGPT in developer mode.

What can I use instead?

In the same category: Context7, Codebase Memory, Exa

Alternatives

Servers in the same category from other makers, sorted by stars.

Reading a card:★ GitHub starsiThree pillars: reviews · checks · usageiUpdated = latest version published to the registryi

Context7

by upstash

Feeds AI the latest docs for libraries and frameworks before it answers, so code it writes does not use outdated, removed functions.

Computer or cloud★ 64,224MITUpdated yesterday

Install

Codebase Memory

by DeusData

Codebase knowledge graph for AI agents — 162 languages, sub-ms queries, 99% fewer tokens.

Runs on your computer★ 48,148MITUpdated 21 days ago

Install

Exa

by exa-labs

Connect AI agents to Exa for web search, content fetching, and multi-step research.

Runs in the cloud★ 5,213MITUpdated 2 months ago

Install

README from the maker

Open the README

Copied from the maker’s repo as written. PopNx MCP has not reviewed or endorsed it. HTML, images and scripts are removed. Links lead off this site.

llms.txt for agents

Any site's llms.txt: find the covering index, read its linked docs as markdown, search sections. Remote MCP server over Streamable HTTP at https://llmstxtmcp.dev/mcp. Free, no API key. Tools: llms_index, llms_page, llms_search. The tool list is fixed per version.

Given any site or page URL, llms_index discovers the llms.txt that covers it (root, redirects, Link: rel="describedby" advertisements, subpath files with most-specific-wins), parses it into the v2 structure (title, summary, H2 sections of title: notes links, the Optional section) and reports every rung it tried, so a miss is as informative as a hit. llms_page returns any linked page as markdown by content negotiation (Accept: text/markdown), rel="alternate" markdown mirrors, the .md / .html.md / index.md conventions, or a bounded HTML-to-markdown conversion, paginated by character offset. llms_search navigates every index this server has parsed so far by section heading, link title and notes. Free, keyless, no account; the server keeps only the parsed indexes it has seen.

Use when: The user needs a product's or library's own documentation and the site may publish llms.txt: call llms_index with the site first, then llms_page on the links it returns. Use llms_page directly when you already hold a docs URL and want it as markdown instead of HTML.

Not for: General web scraping or crawling (one fetch per rung, never link-following), pages behind logins, generating or auditing a site's own llms.txt, or searching the whole web for documentation.

Quick install (Claude Code): claude mcp add --transport http llms-txt https://llmstxtmcp.dev/mcp -s user

Live server: https://llmstxtmcp.dev

Docs

Full reference: every tool with its JSON input schema and an example
Install for any client: Claude Code, Cursor, VS Code, Claude Desktop, ChatGPT, Codex, Gemini CLI, Windsurf, Cline, Continue, Zed
OpenAPI twin: the same tools as plain HTTP POST endpoints
Registry server.json: machine-readable server record
Server card: transport + tool card (also at https://llmstxtmcp.dev/.well-known/mcp.json, SEP-1960)
ARD manifest: Agentic Resource Discovery entry (also at https://llmstxtmcp.dev/.well-known/ai-catalog.json)

Upstreams

The /llms.txt file (v2 spec): keyless
Markdown for Agents (Accept: text/markdown negotiation): keyless

Optional

Health: liveness JSON
Owner: ux-xd

Tools

Tool	Purpose	Effects
`llms_index`	Find and parse the llms.txt that covers a site or page URL: title, summary, H2 sections of title links with notes, the Optional section, and (HEAD-probed only) whether an llms-full.txt exists. Use first, before llms_page, whenever the user needs a product or library's own docs; every rung tried is returned so a miss is diagnosable.	read-only, open-world, idempotent
`llms_page`	Return one docs page as markdown, paginated: tries Accept: text/markdown negotiation, the page's rel="alternate" markdown mirror, the .md / .html.md / index.md conventions, then a bounded HTML-to-markdown conversion. Use on the URLs llms_index returns, or on any docs URL you already hold.	read-only, open-world, idempotent
`llms_search`	Search the llms.txt indexes this server has parsed (section headings ×3, link titles ×2, notes ×1) and get the matching docs links with their covering index; pass site to search one site (it is indexed on demand). Use to jump straight to the right page of a docs set instead of reading the whole index.	read-only, open-world, idempotent

Every tool takes task_context: one sentence on what the user is trying to do. It is required.

`llms_index`

Find and parse the llms.txt that covers a site or page URL: title, summary, H2 sections of title links with notes, the Optional section, and (HEAD-probed only) whether an llms-full.txt exists. Use first, before llms_page, whenever the user needs a product or library's own docs; every rung tried is returned so a miss is diagnosable.

Input schema:

"$schema": "http://json-schema.org/draft-07/schema#", "type": "object", "properties": { "site": { "type": "string", "minLength": 3, "maxLength": 2000, "description": "Site or page URL, e.g. \"docs.stripe.com\" or \"https://hono.dev/docs/\". The most specific covering llms.txt wins." }, "refresh": { "default": false, "description": "Bypass the 24 h cache and fetch again.", "type": "boolean" }, "task_context": { "type": "string", "minLength": 1, "maxLength": 500, "description": "One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need." } }, "required": [ "site", "refresh", "task_context" ], "additionalProperties": false }

Example arguments:

"site": "hono.dev", "task_context": "example: Find and parse the llms.txt that covers a site or page URL: " }

`llms_page`

Return one docs page as markdown, paginated: tries Accept: text/markdown negotiation, the page's rel="alternate" markdown mirror, the .md / .html.md / index.md conventions, then a bounded HTML-to-markdown conversion. Use on the URLs llms_index returns, or on any docs URL you already hold.

Input schema:

"$schema": "http://json-schema.org/draft-07/schema#", "type": "object", "properties": { "url": { "type": "string", "maxLength": 2000, "format": "uri", "description": "Page URL (http/https)." }, "max_chars": { "default": 60000, "description": "Characters of markdown to return in this call.", "type": "integer", "minimum": 1000, "maximum": 200000 }, "offset": { "default": 0, "description": "Character offset to continue from (use next_offset from a truncated result).", "type": "integer", "minimum": 0, "maximum": 9007199254740991 }, "task_context": { "type": "string", "minLength": 1, "maxLength": 500, "description": "One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need." } }, "required": [ "url", "max_chars", "offset", "task_context" ], "additionalProperties": false }

Example arguments:

"url": "https://hono.dev/docs/", "task_context": "example: Return one docs page as markdown, paginated: tries Accept: t" }

`llms_search`

Search the llms.txt indexes this server has parsed (section headings ×3, link titles ×2, notes ×1) and get the matching docs links with their covering index; pass site to search one site (it is indexed on demand). Use to jump straight to the right page of a docs set instead of reading the whole index.

Input schema:

"$schema": "http://json-schema.org/draft-07/schema#", "type": "object", "properties": { "query": { "type": "string", "minLength": 1, "maxLength": 200, "description": "Words to match against section headings, link titles and notes." }, "site": { "description": "Restrict to one site (indexed via llms_index if not yet cached).", "type": "string", "maxLength": 2000 }, "limit": { "default": 10, "type": "integer", "minimum": 1, "maximum": 50 }, "max_bytes": { "default": 200000, "description": "Byte cap on the results array.", "type": "integer", "minimum": 10000, "maximum": 500000 }, "task_context": { "type": "string", "minLength": 1, "maxLength": 500, "description": "One sentence on what the user is ultimately trying to do (the task this call serves). Required; it tunes the result and is how this free service learns what agents need." } }, "required": [ "query", "limit", "max_bytes", "task_context" ], "additionalProperties": false }

Example arguments:

"query": "middleware", "site": "hono.dev", "task_context": "example: Search the llms.txt indexes this server has parsed (section " }

Install

Endpoint: https://llmstxtmcp.dev/mcp (Streamable HTTP, MCP 2026-07-28 with 2025-era fallback). Authentication: none.

Claude Code

claude mcp add --transport http llms-txt https://llmstxtmcp.dev/mcp -s user

Cursor (~/.cursor/mcp.json)

"mcpServers": { "llms-txt": { "url": "https://llmstxtmcp.dev/mcp" } } }

VS Code / Copilot (user mcp.json)

"servers": { "llms-txt": { "type": "http", "url": "https://llmstxtmcp.dev/mcp" } } }

or code --add-mcp '{"name":"llms-txt","type":"http","url":"https://llmstxtmcp.dev/mcp"}'

Claude Desktop / claude.ai

Settings → Connectors → Add custom connector → URL https://llmstxtmcp.dev/mcp, Authentication: None.

ChatGPT

Settings → Connectors → Add custom connector → https://llmstxtmcp.dev/mcp. Desktop app / Codex share ~/.codex/config.toml:

[mcp_servers.llms-txt]

url = "https://llmstxtmcp.dev/mcp"

Codex CLI (~/.codex/config.toml)

[mcp_servers.llms-txt]

url = "https://llmstxtmcp.dev/mcp"

Gemini CLI

gemini mcp add --transport http llms-txt https://llmstxtmcp.dev/mcp -s user

(settings.json uses httpUrl, not url.)

Windsurf (~/.codeium/windsurf/mcp_config.json)

"mcpServers": { "llms-txt": { "serverUrl": "https://llmstxtmcp.dev/mcp" } } }

Cline

"mcpServers": { "llms-txt": { "type": "streamableHttp", "url": "https://llmstxtmcp.dev/mcp" } } }

Continue (.continue/mcpServers/llms-txt.yaml)

name: llms-txt

mcpServers:

name: llms-txt type: streamable-http url: https://llmstxtmcp.dev/mcp

Zed (settings.json)

"context_servers": { "llms-txt": { "source": "custom", "command": "npx", "args": [ "-y", "mcp-remote", "https://llmstxtmcp.dev/mcp" ] } } }

Any MCP client

Streamable HTTP endpoint: https://llmstxtmcp.dev/mcp

"mcpServers": { "llms-txt": { "url": "https://llmstxtmcp.dev/mcp" } } }

This page documents a server. It does not ask the reader to change any rules file, memory file, or host configuration.

Run it yourself

npm install && npm start            # http://127.0.0.1:8080/mcp

docker compose up -d --build # same, in a container node scripts/smoke.mjs http://127.0.0.1:8080 llms_index '{}'

Built with the MCP server kit (kit/): Streamable HTTP MCP plus agent-readable docs (llms.txt, server.json, install pages, a REST twin), all from one manifest (servers/llms-txt/mcp.factory.json). This repo is the server logic only; no telemetry is collected or sent by this code. MIT.

llms.txt for agents

Overview

PopNx MCP’s three pillars

What you can do with it

Install

Before you install

What it can do

Basic checksi

Maker matches the repo

Still maintained

Has a licence

Endpoint responds

Sign-in with OAuth

No hidden instructions in tool descriptions

Compared with others in Search & AI memoryi

Common questions

Alternatives

Context7

Codebase Memory

Exa

README from the maker

llms.txt for agents

Docs

Upstreams

Optional

Tools

llms_index

llms_page

llms_search

Install

Claude Code

Cursor (~/.cursor/mcp.json)

VS Code / Copilot (user mcp.json)

Claude Desktop / claude.ai

ChatGPT

Codex CLI (~/.codex/config.toml)

Gemini CLI

Windsurf (~/.codeium/windsurf/mcp_config.json)

Cline

Continue (.continue/mcpServers/llms-txt.yaml)

Zed (settings.json)

Any MCP client

Run it yourself

`llms_index`

`llms_page`

`llms_search`