How to Create and Publish an llms.txt File for AI Tools

Your audit found no file at https://example.com/llms.txt, the proposed standard location where AI tools can read a short, curated Markdown summary of your site. By the end of this guide you will have written an llms.txt that lists your most important pages with one-line descriptions, published it at your domain root, and confirmed it loads as plain text.

By Updated ⏱ 20 minutes🎯 Beginner● Medium impactGEO / AI
Illustration: llms.txt file fix guide
GEO / AI · FIX GUIDE llms.txt file IMPACTEFFORT TIME20 minutes LEVELBeginner

Why it matters

Search engines and AI assistants work out what your business does by crawling pages full of navigation, scripts and cookie banners. txt gives AI agents, coding assistants and retrieval tools a clean list of the pages you want cited, with your own wording for each one. It is still a community proposal, not a ranking factor.

Google has said it does not use it for Search, and no major AI provider has confirmed it reads the file during crawling. Some AI tools and agents do fetch it, though, and it takes about 20 minutes to publish. It also costs nothing in risk, because it only points to pages that are already public.

✕Beforehttps://example.com/llms.txt returns404 Not Found, so the audit reports"No /llms.txt file."✓Afterhttps://example.com/llms.txt returns200 with a text/plain Markdown filelisting Example Co's key pages, so the

What you need

A list of your 10–30 most important public URLs
A plain-text editor (VS Code, Notepad++, TextEdit in plain-text mode)
Access to your web root, CMS file settings or code repository
A terminal with curl, or a browser, to test the result

Step-by-step fix

1

Pick the pages AI tools should know about

List the URLs that answer the questions people ask about you. Aim for 10–30 links. A typical list includes:

  • Home, product or service pages, and pricing
  • About, contact and location pages
  • Your best guides, docs or FAQs

Skip login pages, cart, search results, tag archives and anything set to noindex. Every URL should be canonical, return 200 and not be blocked in robots.txt.

Pro tip: Use Search Console > Performance > Pages and sort by clicks to find the pages that already earn traffic.
2

Write the file in llms.txt Markdown format

The format follows a fixed order:

  • An H1 with your site or company name. This is the only required line.
  • A blockquote (>) with a one-sentence summary.
  • Optional plain paragraphs of context.
  • H2 sections that hold link lists in the form - [Title](URL): description.

A section titled ## Optional marks links that tools can skip when space is short. Use full absolute URLs and keep each description to one factual line.

text
# Example Co

> Example Co makes online booking and reminder software for independent dental clinics in the UK and Ireland.

Prices are in GBP and exclude VAT. Support is available Monday–Friday, 9:00–17:30 UK time.

## Key pages

- [Product overview](https://example.com/product): What the booking app does and who it is for
- [Pricing](https://example.com/pricing): Monthly and annual plans and what each tier includes
- [About Example Co](https://example.com/about): Company background, team and contact details
- [Contact](https://example.com/contact): Sales and support email, phone and office address

## Docs

- [Getting started](https://example.com/docs/getting-started): Set up your clinic account in 15 minutes
- [Integrations](https://example.com/docs/integrations): Supported practice-management and calendar systems
- [FAQ](https://example.com/faq): Answers on data security, contracts and cancellations

## Optional

- [Blog](https://example.com/blog): Articles on running a dental practice
- [Changelog](https://example.com/changelog): Product release notes
Pro tip: Write descriptions as facts an AI could quote back accurately, such as prices, locations and audiences. Avoid slogans.
3

Save it as UTF-8 plain text named llms.txt

txt, in lowercase. Save it with UTF-8 encoding and Unix (LF) line endings. txt.

Do not wrap the content in HTML.

4

Upload the file to your domain root

The file must load at https://example.com/llms.txt. A subfolder such as /docs/llms.txt will not count. How you get it there depends on your setup:

  • Static sites and traditional hosting: upload it next to robots.txt over SFTP or your host's File Manager. This folder is usually public_html or /var/www/html.
  • Frameworks: place it in the folder served at the root, such as public/.
  • Hosted platforms: see the platform notes below.
text
scp llms.txt user@example.com:/var/www/html/llms.txt
Pro tip: If you run both www and non-www, check that the version you do not use redirects to the one that serves the file.
5

Serve it as text/plain with a 200 status

txt to text/plain`. Problems tend to come from catch-all routing instead. Rewrite rules, SPA fallbacks and security plugins can return your homepage HTML or a 403 instead of the file.

If that happens, add an explicit rule for the path. On Nginx, use the block below.

nginx
location = /llms.txt {
    default_type text/plain;
    charset utf-8;
    try_files $uri =404;
}
Pro tip: Do not block /llms.txt in robots.txt, and do not put it behind a login, bot challenge or geo-block.
6

Add a review date to your publishing checklist

txt that links to deleted pages sends AI tools to 404s. Update the file whenever you launch, rename or remove a key page or change pricing. Otherwise review it every quarter.

txt` that contains the full text of your docs in one Markdown file.

Pro tip: Keep llms.txt in version control so changes are reviewed together with the site.
7

Check the live file

Fetch the URL from outside your network and confirm three things:

  • The status is 200.
  • The content-type is text/plain.
  • The body starts with your # Example Co heading, not HTML.

Then click a sample of the links to confirm none of them redirect or return 404. Finally, re-run the audit.

text
curl -sI https://example.com/llms.txt
curl -s https://example.com/llms.txt | head -n 10
Pro tip: Add -L to the first command to see whether a redirect chain sits in front of the file.

Platform-specific notes

WordPress

Upload llms.txt to the WordPress root folder (the one containing wp-config.php) using SFTP or your host's File Manager. Recent versions of Yoast SEO and Rank Math include an llms.txt generator, so check your SEO plugin's settings for an llms.txt option. If you use one, choose the pages manually rather than letting it list every post. Do not run a plugin generator and a manual file at the same time, because the physical file overrides the plugin.

Shopify

Shopify does not let you upload files to the store root. The usual workaround has two parts. First, upload llms.txt in Content > Files and copy its CDN URL. Then, in Online Store > Navigation > URL Redirects (or Settings > Apps and sales channels > Online Store, depending on the admin version), create a redirect from /llms.txt to that URL. This only works while /llms.txt itself returns 404. Alternatively, install an llms.txt app from the Shopify App Store that serves the file through an app proxy.

Next.js

Put llms.txt in the /public folder and it will be served at /llms.txt. To build it from your CMS or routes instead, create app/llms.txt/route.ts that exports a GET handler. Add export const dynamic = 'force-static' to it, and have it return new Response(text, { headers: { 'Content-Type': 'text/plain; charset=utf-8' } }). Also check that middleware.ts does not rewrite or redirect the path.

Webflow / Wix

Neither platform gives you raw access to the root folder. Check the SEO settings for a built-in llms.txt field: Webflow uses Site settings > SEO, and Wix uses Dashboard > Marketing & SEO > SEO. Both platforms have been adding AI-crawler controls. If no field exists, serve the file through a proxy in front of the site, such as a Cloudflare Worker.

Cloudflare

If your origin cannot host the file, create a Worker on the route example.com/llms.txt that returns the Markdown with Content-Type text/plain; charset=utf-8. Make sure Bot Fight Mode or WAF rules do not challenge requests to /llms.txt, otherwise AI tools receive a challenge page instead of the file.

Check that it worked

✅ How to verify

  • Open https://example.com/llms.txt in a private browser window. You should see raw Markdown text, not a rendered page or a download prompt.
  • Run curl -sI https://example.com/llms.txt and confirm HTTP 200 and content-type: text/plain.
  • Spot-check at least five links in the file and confirm each returns 200 without redirects.
  • Re-run the audit and confirm the check now reports "/llms.txt found."

⚠️ Common mistakes

  • Saving the file as llms.txt.txt, LLMS.txt or llms.md. The path must be exactly /llms.txt in lowercase.
  • Leaving an SPA or CMS catch-all route in place, so /llms.txt returns your homepage HTML with a 200 status.
  • Pasting your entire sitemap into the file. llms.txt is meant to be a short, curated list with descriptions, not every URL.
  • Using relative links (/pricing) or linking to noindexed, redirected or deleted pages.

Is this still an issue on your site? Run a free audit — ZORO checks this and 294 other SEO, AI-visibility, accessibility and security signals, with fixes for your platform.

Check my site free

FAQ

Does llms.txt improve Google rankings?

No. Google has said it does not use llms.txt for Search or AI Overviews. Treat it as a low-effort hint for AI tools and agents that choose to read it, not as a ranking factor.

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers what they may or may not access. llms.txt is a guide that points AI tools to your most useful content. To block or allow AI crawlers such as GPTBot, you still use robots.txt.

What is the difference between llms.txt and llms-full.txt?

llms.txt is a short index of links with one-line summaries. llms-full.txt is an optional companion file that holds the full text of your key pages or docs in one Markdown file. It is most useful for documentation and developer sites.

How long should an llms.txt file be?

Most business sites need 10–30 links grouped under a few H2 sections. Keep each description to one line. Any extra content belongs on your pages or in llms-full.txt, not in the index.