Answer Engine Optimization
Does llms.txt Actually Work? What the Data Says
llms.txt is the tidy technical fix for AI visibility that spread through SEO circles faster than anyone stopped to test it. So here is the question nobody selling it wants to answer directly: does it actually work? The evidence is clearer than the hype suggests, and it points somewhere more useful.
Key takeaways
- The honest verdict: there is no evidence llms.txt currently improves AI visibility. No major assistant has confirmed it reads the file, and no published case study shows measurable lift.
- An Ahrefs study of roughly 137,000 sites found 97% of llms.txt files were never fetched by AI crawlers, meaning the file is largely being ignored, not consumed.
- The community has landed in the same place: practitioners report that no current LLM reads llms.txt, and that despite looking, they cannot find a single case study proving it works.
- It is not a scam. The file is free, harmless, and well-intentioned. It is simply a proposed standard the AI providers it depends on have not adopted, which is a different problem than deception.
- What actually moves AI answers is being citable evidence: answer-first, well-sourced, fresh content on the surfaces answers draw from, then measuring whether specific answers change. That is where your effort belongs.
Few ideas in AI search have spread as fast, on as little evidence, as llms.txt. The pitch is irresistible to anyone who wants a clean technical checkbox: drop a curated text file at the root of your domain, and AI assistants will use it to understand and cite you. It sounds like the robots.txt of the AI era. It is being sold in audits, bundled into SEO tools, and added to sites by the thousands. And yet the most basic question keeps getting skipped.
Does it actually do anything? The people closest to the data are blunt about the answer.
“There is not a single LLM that reads, supports, or uses llms.txt. Not ChatGPT. Not Claude. Not Gemini. Not Perplexity.”
That is a strong claim, so this guide treats it as a claim to test, not a conclusion to assume. Below is what the studies show, what practitioners are finding in their own logs, why the gap exists, and, most importantly, where the effort you would have spent on llms.txt actually pays off.
1Does llms.txt work? The short verdict.
If you only read one paragraph: as of mid-2026, there is no credible evidence that llms.txt improves how AI assistants understand, rank, or cite your site. No major answer engine has confirmed that it reads the file, large-scale crawl data shows the files are almost never fetched, and no one has published a case study demonstrating lift. The file is harmless and free, so adding one is not a mistake, but treating it as a meaningful AI-visibility lever is.
The rest of this piece is the evidence behind that verdict, and the work that does move the needle.
2What is llms.txt, and what is it supposed to do?
llms.txt is a proposed convention: a Markdown file placed at the root of a domain (for example, yoursite.com/llms.txt) that gives large language models a clean, curated map of your most important content. A companion file, llms-full.txt, is meant to hold the expanded text. The stated goal is to spare models from parsing cluttered HTML, navigation, and scripts, and instead hand them a distilled version of what matters.
The intuition is reasonable, and the analogy to robots.txt and XML sitemaps is deliberate. But that analogy is exactly where the trouble begins, and we will come back to it. A file convention only becomes a standard when the systems it targets agree to read it. llms.txt is a proposal waiting for that agreement, not a mechanism that is already wired into how AI assistants work.
3What does the data actually say about llms.txt?
The single most useful data point comes from Ahrefs, which studied the behavior of AI crawlers across a large sample of sites. The finding is hard to argue with: 97% of llms.txt files were never fetched by AI crawlers across roughly 137,000 sites. If the files are not even being requested, they cannot be shaping an answer. This is not a subtle effectiveness question; it is a question of whether the door is ever opened, and overwhelmingly it is not.
Sources: Ahrefs' llms.txt study, Ahrefs on citation freshness, and Ahrefs on schema and AI citations.
It is worth pairing that with a second Ahrefs finding, because it shows a pattern. When Ahrefs tested whether adding structured-data markup changed AI citations, the measured difference was effectively zero. Declarative, tell-the-machine-what-you-are techniques keep under-delivering against expectations. What correlates with getting cited is more mundane: for instance, ChatGPT tends to cite content that is, on average, about 458 days fresher than the pages that do not get cited. A separate text file does not make your content fresher, more sourced, or more directly useful. It just sits there.
4What are practitioners actually finding?
Independent of the vendor studies, the practitioner consensus has converged, and it is not a marketing consensus, it is a checked-the-logs one. The clearest summary is the one that opened this piece: no current LLM reads, supports, or uses llms.txt. But the more telling observation is about the evidence gap. If llms.txt worked, by now someone would have proven it. Someone went looking:
“I have not seen any case studies about an llms txt file… resulting in measurable improvements. I have looked and not found one.”
This is the quiet tell. In a discipline where every genuine tactic accumulates a trail of before-and-after screenshots and case studies, llms.txt has produced none. The absence of evidence, after this much adoption and this much attention, is itself a finding. It is the same pattern practitioners hit with other appealing shortcuts, such as adding schema in isolation:
“Week 2 variable: I added FAQPage JSON-LD schema to two pages… Result: 0/6. The same as the Week 1 baseline.”
The lesson is not that technical hygiene is worthless. It is that declaring what you are to a machine is not the same as being the thing it finds most citable at answer time.
5Is llms.txt a scam, or is it just early?
It is important to be fair here, because the skeptical case is easy to overstate. llms.txt is not a scam. It is a genuine, well-intentioned proposal from people trying to make the web more legible to AI. The file is free to create, it takes minutes, and it does no harm: it will not hurt your SEO, will not confuse search crawlers, and carries no real downside beyond the time you spend on it. If you have already added one, leave it. If you want to add one as a low-effort hedge against future adoption, that is a defensible bet.
The honest framing is that llms.txt is early and unadopted, not fraudulent. The danger is not the file itself; it is opportunity cost. When a tidy technical checkbox gets sold as an AI-visibility strategy, teams check the box, feel productive, and skip the harder work that actually changes what AI recommends. The scam-adjacent behavior, if any exists, is in overselling a proposal as a proven lever, not in the proposal.
6Why don't AI answer engines use llms.txt yet?
The reason comes back to the robots.txt analogy that sold the idea in the first place. Robots.txt and XML sitemaps work for one reason only: search engines publicly committed to reading them and built their crawlers around the convention. The file is not magic; the commitment is. llms.txt has the file but not the commitment.
| Convention | Why it does or does not work |
|---|---|
| robots.txt / sitemap.xml | Works because Google, Bing, and others formally adopted the standard and their crawlers consume it. The commitment came first. |
| Structured data / schema | Read by search engines, but its measured effect on AI citations is effectively zero (Ahrefs). Being parsed is not the same as being decisive. |
| llms.txt | No major AI provider has confirmed support, and crawl data shows 97% of files are never fetched (Ahrefs). A proposed convention without adoption. |
There is also a practical reason providers have little incentive to switch. Modern AI assistants already retrieve and render live web pages through search and crawling infrastructure. They do not need a vendor-curated summary, and arguably should distrust one, since an llms.txt file is exactly the place a site would put its most flattering self-description. Answer engines lean toward third-party corroboration; Neil Patel's analysis found that over 80% of AI citations come from third-party sources, not the brand's own pages. A file that only contains what you say about yourself is working against that grain.
7What actually works instead of llms.txt?
If the goal behind adding llms.txt is to be understood and recommended by AI, the good news is that the tactics that genuinely move that outcome are well-documented, if less tidy. The through-line is simple: you cannot declare your way into an answer, you have to be the most citable evidence available. Three properties do most of the work.
- Answer-first, self-contained content. Lead each page with a direct, liftable answer to the question a buyer actually asks, then support it. Pages that AI cites carry noticeably more concrete, factual coverage of their topic than pages that do not, roughly 31% key-fact coverage versus 24% in Surfer's analysis. Facts and clear answers are what get lifted; a curated text file is not.
- Sources and third-party presence. Back claims with citations, and earn presence on the review sites, comparison pages, and community threads answers draw from, since the majority of AI citations are third-party. This is also why simply being present is not enough: it is worth understanding what makes answer engines cite content in the first place.
- Freshness. Keep pages current. ChatGPT cites content that is, on average, about 458 days fresher than what it passes over. A recently updated, accurate page beats a static declaration every time.
None of that is a one-time file drop. It is a loop: measure which buying questions currently return a competitor, read the evidence those answers cite, publish a source-backed fix on the surfaces that matter, then re-measure the same question to confirm the answer moved. That is the method behind getting recommended by AI and getting cited by Perplexity and ChatGPT, and it is the opposite of hoping a file gets read.
Measure whether your AI answers actually change
8How should you treat llms.txt going forward?
Take a pragmatic position. If adding llms.txt costs you an afternoon and nothing more, adding one as a hedge is fine; adoption could improve, and there is no penalty for having it. But do three things to stay honest about it: do not attribute any AI-visibility change to it without evidence, do not let it crowd out real content and measurement work, and do not pay a premium for a tool or service whose main promise is generating the file.
The category's deeper lesson is the one to internalize. AI search rewards being genuinely useful and genuinely citable, verified by re-measuring specific answers, not by declaring yourself important in a text file. When a provider announces it reads llms.txt and someone publishes a measured result, this verdict will be updated here. Until then, the answer to "does llms.txt work" is: not yet, and probably not the way you were told.
Frequently asked questions
Does llms.txt work?+
Based on the available evidence, no, not in the sense most people hope for. There is no confirmed case of a major AI assistant reading an llms.txt file to build an answer, an Ahrefs study of roughly 137,000 sites found 97% of llms.txt files were never fetched by AI crawlers, and no published case study demonstrates measurable ranking or citation lift from adding one. The honest position is that llms.txt is a proposed standard that has not been adopted by the model providers it targets, so it does not currently influence what AI recommends.
Do ChatGPT, Claude, Gemini, or Perplexity read llms.txt?+
None of them have confirmed support, and practitioners who have looked at server logs report that the files are not being fetched at answer time. OpenAI, Anthropic, Google, and Perplexity have not announced that their assistants consume llms.txt, and their crawlers retrieve and render normal web pages rather than a separate curated text file. Until a provider states otherwise, assume your llms.txt is not being read.
Is llms.txt a scam?+
No. It is a genuine, well-intentioned proposal, it is free to create, and it does no harm to your site. The problem is not deception; it is a gap between a sensible-sounding idea and actual adoption by the AI companies it depends on. Treat it as a low-cost, low-priority experiment, not as a lever that will change your AI visibility.
Should I still add an llms.txt file?+
You can, because the downside is close to zero and there is a small chance adoption improves later. But do not let it displace the work that actually moves AI answers: publishing answer-first, well-sourced, recently updated content and earning presence on the third-party sources answer engines cite. Add the file in an afternoon if you want, then spend your real effort on evidence.
What should I do instead of relying on llms.txt for AI visibility?+
Make your product easy to cite. That means writing content that answers specific buying questions directly and self-containedly, backing claims with sources and concrete facts, keeping pages fresh, and being present on the review sites, comparison pages, and community threads that answers draw from. Then measure whether specific AI answers actually change, rather than assuming any single technical file did the work.
Is llms.txt the same as robots.txt or a sitemap?+
It borrows the convention of a root-level text file, but the comparison is where the confusion starts. Robots.txt and sitemaps work because search engines committed to reading them; llms.txt only works if AI providers commit to reading it, and so far they have not. A format is only a standard once the systems it targets actually consume it.
Related guides
- How to Get Recommended by AI: B2B SaaS Guide
- How to Get Cited by Perplexity and ChatGPT
- What Makes AI Answer Engines Cite Your Content
- What Is Answer Engine Optimization (AEO)?
- How to Measure AI Search Visibility (Honestly)
- Why ChatGPT Recommends Your Competitor Instead of You
- Answer Radar: Answer Engine Optimization