How to Create and Publish an llms.txt File for AI Tools
Your audit found no file at https://example.com/llms.txt, the proposed standard location where AI tools can read a short, curated Markdown summary of your site. By the end of this guide you will have written an llms.txt that lists your most important pages with one-line descriptions, published it at your domain root, and confirmed it loads as plain text.

Why it matters
Search engines and AI assistants work out what your business does by crawling pages full of navigation, scripts and cookie banners. txt gives AI agents, coding assistants and retrieval tools a clean list of the pages you want cited, with your own wording for each one. It is still a community proposal, not a ranking factor.
Google has said it does not use it for Search, and no major AI provider has confirmed it reads the file during crawling. Some AI tools and agents do fetch it, though, and it takes about 20 minutes to publish. It also costs nothing in risk, because it only points to pages that are already public.
What you need
Step-by-step fix
Pick the pages AI tools should know about
List the URLs that answer the questions people ask about you. Aim for 10–30 links. A typical list includes:
- Home, product or service pages, and pricing
- About, contact and location pages
- Your best guides, docs or FAQs
Skip login pages, cart, search results, tag archives and anything set to noindex. Every URL should be canonical, return 200 and not be blocked in robots.txt.
Write the file in llms.txt Markdown format
The format follows a fixed order:
- An H1 with your site or company name. This is the only required line.
- A blockquote (
>) with a one-sentence summary. - Optional plain paragraphs of context.
- H2 sections that hold link lists in the form
- [Title](URL): description.
A section titled ## Optional marks links that tools can skip when space is short. Use full absolute URLs and keep each description to one factual line.
# Example Co > Example Co makes online booking and reminder software for independent dental clinics in the UK and Ireland. Prices are in GBP and exclude VAT. Support is available Monday–Friday, 9:00–17:30 UK time. ## Key pages - [Product overview](https://example.com/product): What the booking app does and who it is for - [Pricing](https://example.com/pricing): Monthly and annual plans and what each tier includes - [About Example Co](https://example.com/about): Company background, team and contact details - [Contact](https://example.com/contact): Sales and support email, phone and office address ## Docs - [Getting started](https://example.com/docs/getting-started): Set up your clinic account in 15 minutes - [Integrations](https://example.com/docs/integrations): Supported practice-management and calendar systems - [FAQ](https://example.com/faq): Answers on data security, contracts and cancellations ## Optional - [Blog](https://example.com/blog): Articles on running a dental practice - [Changelog](https://example.com/changelog): Product release notes
Save it as UTF-8 plain text named llms.txt
txt, in lowercase. Save it with UTF-8 encoding and Unix (LF) line endings. txt.
Do not wrap the content in HTML.
Upload the file to your domain root
The file must load at https://example.com/llms.txt. A subfolder such as /docs/llms.txt will not count. How you get it there depends on your setup:
- Static sites and traditional hosting: upload it next to
robots.txtover SFTP or your host's File Manager. This folder is usuallypublic_htmlor/var/www/html. - Frameworks: place it in the folder served at the root, such as
public/. - Hosted platforms: see the platform notes below.
scp llms.txt user@example.com:/var/www/html/llms.txt
Serve it as text/plain with a 200 status
txt to text/plain`. Problems tend to come from catch-all routing instead. Rewrite rules, SPA fallbacks and security plugins can return your homepage HTML or a 403 instead of the file.
If that happens, add an explicit rule for the path. On Nginx, use the block below.
location = /llms.txt {
default_type text/plain;
charset utf-8;
try_files $uri =404;
}Add a review date to your publishing checklist
txt that links to deleted pages sends AI tools to 404s. Update the file whenever you launch, rename or remove a key page or change pricing. Otherwise review it every quarter.
txt` that contains the full text of your docs in one Markdown file.
Check the live file
Fetch the URL from outside your network and confirm three things:
- The status is 200.
- The
content-typeistext/plain. - The body starts with your
# Example Coheading, not HTML.
Then click a sample of the links to confirm none of them redirect or return 404. Finally, re-run the audit.
curl -sI https://example.com/llms.txt curl -s https://example.com/llms.txt | head -n 10
Platform-specific notes
WordPress
Upload llms.txt to the WordPress root folder (the one containing wp-config.php) using SFTP or your host's File Manager. Recent versions of Yoast SEO and Rank Math include an llms.txt generator, so check your SEO plugin's settings for an llms.txt option. If you use one, choose the pages manually rather than letting it list every post. Do not run a plugin generator and a manual file at the same time, because the physical file overrides the plugin.
Shopify
Shopify does not let you upload files to the store root. The usual workaround has two parts. First, upload llms.txt in Content > Files and copy its CDN URL. Then, in Online Store > Navigation > URL Redirects (or Settings > Apps and sales channels > Online Store, depending on the admin version), create a redirect from /llms.txt to that URL. This only works while /llms.txt itself returns 404. Alternatively, install an llms.txt app from the Shopify App Store that serves the file through an app proxy.
Next.js
Put llms.txt in the /public folder and it will be served at /llms.txt. To build it from your CMS or routes instead, create app/llms.txt/route.ts that exports a GET handler. Add export const dynamic = 'force-static' to it, and have it return new Response(text, { headers: { 'Content-Type': 'text/plain; charset=utf-8' } }). Also check that middleware.ts does not rewrite or redirect the path.
Webflow / Wix
Neither platform gives you raw access to the root folder. Check the SEO settings for a built-in llms.txt field: Webflow uses Site settings > SEO, and Wix uses Dashboard > Marketing & SEO > SEO. Both platforms have been adding AI-crawler controls. If no field exists, serve the file through a proxy in front of the site, such as a Cloudflare Worker.
Cloudflare
If your origin cannot host the file, create a Worker on the route example.com/llms.txt that returns the Markdown with Content-Type text/plain; charset=utf-8. Make sure Bot Fight Mode or WAF rules do not challenge requests to /llms.txt, otherwise AI tools receive a challenge page instead of the file.
Check that it worked
✅ How to verify
- Open https://example.com/llms.txt in a private browser window. You should see raw Markdown text, not a rendered page or a download prompt.
- Run curl -sI https://example.com/llms.txt and confirm HTTP 200 and content-type: text/plain.
- Spot-check at least five links in the file and confirm each returns 200 without redirects.
- Re-run the audit and confirm the check now reports "/llms.txt found."
⚠️ Common mistakes
- Saving the file as llms.txt.txt, LLMS.txt or llms.md. The path must be exactly /llms.txt in lowercase.
- Leaving an SPA or CMS catch-all route in place, so /llms.txt returns your homepage HTML with a 200 status.
- Pasting your entire sitemap into the file. llms.txt is meant to be a short, curated list with descriptions, not every URL.
- Using relative links (/pricing) or linking to noindexed, redirected or deleted pages.
Is this still an issue on your site? Run a free audit — ZORO checks this and 294 other SEO, AI-visibility, accessibility and security signals, with fixes for your platform.
Check my site freeFAQ
Does llms.txt improve Google rankings?
No. Google has said it does not use llms.txt for Search or AI Overviews. Treat it as a low-effort hint for AI tools and agents that choose to read it, not as a ranking factor.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may or may not access. llms.txt is a guide that points AI tools to your most useful content. To block or allow AI crawlers such as GPTBot, you still use robots.txt.
What is the difference between llms.txt and llms-full.txt?
llms.txt is a short index of links with one-line summaries. llms-full.txt is an optional companion file that holds the full text of your key pages or docs in one Markdown file. It is most useful for documentation and developer sites.
How long should an llms.txt file be?
Most business sites need 10–30 links grouped under a few H2 sections. Keep each description to one line. Any extra content belongs on your pages or in llms-full.txt, not in the index.
How to Fix Content That Isn't Readable Without JavaScript
How to Fix a CDN or WAF Blocking AI Crawlers
How to Get Your Brand Mentioned in ChatGPT Answers
How to Set an Explicit Google-Extended Policy in robots.txt
How to Get Your Brand Mentioned in Perplexity Answers
How to Allow PerplexityBot in robots.txt and Your Firewall