
What Is llms.txt, and Does Your Small Business Need One?
Someone probably told you your website needs an "llms.txt file" now, the same way people once insisted you needed a blog, an app, and a TikTok. Before you add another chore to the pile, it helps to know what this file actually is, what it isn't, and whether a small business needs one at all. The short version: it's cheap, it's honest work, and it might help, just not in the magical way some people sell it.
What is an llms.txt file, in plain English?
It's a single plain-text file that sits at the root of your website, at yoursite.com/llms.txt, and hands AI assistants a short, curated map of your site. Think of it as a one-page index: your business name, a sentence about what you do, and a tidy list of your most important pages, each with a one-line description written in plain language. It uses Markdown, a simple text format, so both people and machines can read it. The idea was proposed by Jeremy Howard of Answer.AI in September 2024 as a way to give language models clean, LLM-friendly information about a site (Answer.AI).
Why would a site need this? Because AI assistants read the web awkwardly. They have a limited amount of text they can hold at once, and a normal web page is stuffed with menus, cookie banners, ads, and code that has nothing to do with the answer someone asked for. An llms.txt file skips all that noise. Instead of making the AI dig through your HTML, you hand it a clean summary and point it straight at the pages that matter.
How is llms.txt different from robots.txt?
They sound similar and live in the same place, but they do opposite jobs. robots.txt is a gate: it tells crawlers which parts of your site they may or may not visit, and most well-behaved bots obey it. llms.txt is a welcome map: it points AI toward your best content and describes it, but it can't block or force anything. One controls access; the other offers guidance.
- robots.txt is an established standard that controls crawling. Search and AI crawlers check it, and reputable ones respect it.
- llms.txt is a newer proposal that suggests and describes content. It has no power to keep anyone out.
- You keep both. llms.txt is not a replacement for robots.txt; they solve different problems (Search Engine Land).
- robots.txt is widely obeyed today. llms.txt is still emerging, and not every AI reads it.
Does llms.txt help me rank or get cited by AI?
Here's the honest part, because plenty of posts online will not tell you: llms.txt is not a ranking hack, and no major AI provider has committed to reading the llms.txt of arbitrary business sites. Google has been blunt about it. Its search advocate John Mueller has said none of the AI services have confirmed they use llms.txt, and that server logs show the crawlers don't even check for the file (Ahrefs). OpenAI and Google both manage AI crawling through robots.txt, not llms.txt. So if someone promises that adding this file will get you cited by ChatGPT or lift your Google rankings, be skeptical.
The honest upside is smaller and more reasonable: llms.txt is low-cost insurance. It takes about an hour and costs nothing. If the standard catches on and assistants start using it, you're already set up. In the meantime, the exercise of writing one, deciding which pages actually matter and describing each in a clean sentence, is useful on its own, and any AI tool you point at your own site will read it happily. You are not betting the business on it. You are spending an hour on something that can only help.
Who actually benefits from an llms.txt file?
It depends on how much content you have. The more pages an AI could get wrong about you, the more a curated map helps. If your whole site is five pages, the payoff is thin.
- Sites with real depth benefit most: documentation, help centers, guides, or lots of product and service pages. There's plenty for an AI to misread, so a map earns its keep.
- Software and technical products already lead here. Developer docs are where the idea started, because feeding an assistant clean Markdown saves it a lot of guessing.
- A simple five-page local business gets little from it. If a person can skim your whole site in a minute, so can an AI. Your opening hours, services, and reviews matter far more than this file.
What goes inside an llms.txt file?
The format is deliberately plain. It's a Markdown file, which just means readable text with a few light marks for headings and links. You don't need a developer to understand it. At its simplest, it has four parts.
- A title with your business or site name, written as a single top-level heading.
- A one-sentence summary of what you do and who you serve.
- A short list of your most important pages, each as a link with a plain one-line description, for example: "Pricing: plans, what's included, and who each is for."
- An optional section for secondary pages you'd want included only if there's room.
The key word is curated. This is an editor's pick, not a full sitemap dumped into a file. Point to your best, canonical pages and describe each one accurately. A short, honest map that reflects what you actually do is worth more than a long list of everything you've ever published.
How do I create an llms.txt file?
You have two paths: write it by hand, or let a tool draft it for you. By hand is genuinely simple, and it forces you to decide what matters, which is the valuable part.
- List your 5 to 15 most important pages, the ones you'd want an AI to quote correctly: services, pricing, about, contact, and your best guides.
- Write a heading with your business name, then one sentence describing what you do and who it's for.
- Group the links under a couple of simple headings and give each link a short, accurate description.
- Save it as a plain text file named exactly llms.txt.
- Upload it to the root of your site so it lives at yoursite.com/llms.txt. If you can already reach yoursite.com/robots.txt, that's the same place it goes.
Prefer not to touch files? A number of generators and CMS plugins will build a draft llms.txt from your existing pages, and several WordPress plugins do this automatically. That's fine, but always read the result. A tool doesn't know which of your pages you'd stake your reputation on, so trim it down and fix the descriptions until the map sounds like you.
So does my small business actually need one?
Probably not urgently, and definitely not before the basics. If AI assistants can't describe your business correctly today, an llms.txt file is rarely the missing piece. The usual culprits are simpler: a thin website, unclear pages, or nothing that plainly states what you do and where. It's worth understanding why AI can't find your business and how to show up in AI search before you optimize a file most crawlers aren't reading yet.
Fix the foundation first: pages that clearly answer real questions, accurate business details, and steady, useful content are what actually get you recommended by ChatGPT and its peers. If keeping that content fresh is the part you never get to, that's the gap Laspi fills: its WordPress plugin writes SEO and AI-search articles grounded in your real business, so the site an assistant reads stays clear and current. Then add llms.txt as the cheap finishing touch, not the main course.
So: is llms.txt worth it? For most small businesses, it's a reasonable hour of insurance, not a growth strategy. It's an emerging standard, not a guarantee, and honesty about that is the whole point. Do the basics that AI already rewards, spend an hour on a clean llms.txt if you have the content to justify it, and skip anyone selling it as a shortcut.
Frequently asked questions
- What is an llms.txt file?
- It's a Markdown file at yoursite.com/llms.txt that gives AI assistants a short, curated list of your most important pages, each with a one-line description. It was proposed by Jeremy Howard of Answer.AI in 2024. It's a community proposal, not an official requirement.
- Is llms.txt the same as robots.txt?
- No. robots.txt controls which pages crawlers are allowed to access, while llms.txt only suggests and describes your best content and can't block anything. You keep both files, because they do different jobs.
- Does Google or ChatGPT use llms.txt?
- Not officially. No major AI provider has confirmed that it reads the llms.txt of ordinary business sites, and Google has publicly said it doesn't use it. Treat it as optional insurance, not a ranking factor.
- How do I create an llms.txt file?
- List your 5 to 15 key pages, write a title and a one-sentence summary, add each page as a link with a short description, save it as llms.txt, and upload it to your site's root. A generator or CMS plugin can draft one for you to review and trim.
- Is llms.txt worth it for a small business?
- If your site is small and simple, the payoff is minor, so spend your time on clear pages and reviews first. If you have lots of guides or products, an hour spent on a clean llms.txt is cheap insurance for the day AI assistants start using it.
Sources
- Answer.AI, 2024 — llms.txt was proposed by Jeremy Howard of Answer.AI on September 3, 2024, as a Markdown file placed at /llms.txt to give language models curated, LLM-friendly information about a website.
- Search Engine Land, 2025 — llms.txt is a proposed standard, not all AI companies adhere to it, and it is not intended to be a substitute for robots.txt.
- Ahrefs, 2025 — No major LLM provider (OpenAI, Anthropic, Google) has formally adopted llms.txt; Google's John Mueller said none of the AI services have confirmed using it and server logs show crawlers don't check for the file.