AI search

What is llms.txt? The AI-search file, explained

Guide · Updated 2026-10-07

A tiny Markdown file that hands AI engines a clean map of your best content. Here's what it is and how to use it.

In one line: llms.txt is a Markdown file at your site root (yourdomain.com/llms.txt) that gives AI models a curated, readable map of your most important pages — helping ChatGPT, Perplexity, Claude and others understand and cite your site. Create one free here.

What is llms.txt?

llms.txt is a plain-text Markdown file placed at the root of your website, exactly like robots.txt. Its job is to give large language models a clean, human-curated summary of what your site is and which pages matter most. Modern websites are full of navigation, scripts and ads; llms.txt cuts through the noise with a single file that says "here's the site, and here are the pages worth reading."

Why it exists

Search is shifting from blue links to AI answers. Engines like ChatGPT, Perplexity, Google's AI Overviews and Claude read sources and synthesize responses, often citing a few. But they don't experience your site like a human — they parse text. The more clearly you present your key content, the more accurately they can understand and cite it. llms.txt is a low-effort way to do exactly that, and it's part of the wider practice of GEO and AEO.

The llms.txt format

It's just Markdown, with a simple structure:

Example:

# Acme Analytics
> Privacy-first web analytics for small teams.

## Pages
- [Docs](https://acme.com/docs): setup and API reference
- [Pricing](https://acme.com/pricing): plans and pricing

Because it's plain Markdown, it stays readable to both humans and machines. Our llms.txt generator builds this structure for you.

llms.txt vs robots.txt vs sitemap.xml

FileAudienceJob
robots.txtAll crawlersWhat they may or may not access
sitemap.xmlSearch enginesA full list of every URL to crawl
llms.txtAI modelsA short, curated, described set of your best content

They complement each other — having all three is ideal. llms.txt is the opposite of a full URL dump: it's hand-picked and described.

How to create and install one

  1. Generate the file with our free llms.txt generator — add your site name, one-line summary and key pages.
  2. Save it as exactly llms.txt.
  3. Upload it to the root of your site so it opens at yourdomain.com/llms.txt (same place as robots.txt).
  4. Confirm it loads by visiting the URL. Update it whenever you add important pages.

Does it actually work?

Adoption across the AI ecosystem is growing, and because the file is tiny and risk-free, there's little downside. Even where an engine doesn't consume it yet, it does no harm and future-proofs your site. Think of it as an easy, AI-friendly layer on top of good content and solid SEO — not a replacement for either.

Frequently asked questions

Where do I put the llms.txt file?

At the root of your domain so it's reachable at yourdomain.com/llms.txt, exactly like robots.txt. A file in a subfolder won't be found.

Is llms.txt the same as robots.txt?

No. robots.txt restricts what crawlers can access. llms.txt does the opposite — it highlights and describes your best content so AI models can find and cite it.

Do AI engines actually use llms.txt?

Adoption is growing across AI search. It's a low-effort, low-risk addition; even where it isn't consumed yet it does no harm and prepares your site for AI-driven discovery.

How do I make an llms.txt file?

Use our free llms.txt generator: enter your site name, a one-line summary and your key pages, then copy or download the file and upload it to your site root.

Advertisement

Check your page for SEO & AI search — free

SEOGlint scans any page for on-page SEO, technical health and GEO/AEO readiness in one click.

Run a free audit