Four months ago, I added llms.txt and llms-full.txt files to my blog. Time to look at the numbers.
What is llms.txt
It’s essentially robots.txt for language models. A file in the site’s root directory that helps AI systems — ChatGPT, Perplexity, Claude, Gemini — better understand the structure and content of your website. I wrote more about it in a separate post.
My files:
Methodology
I compared two 4-month periods:
| Period | Dates | Status |
|---|
| Before | March 18 — July 17, 2024 | without llms.txt |
| After | July 18 — November 18, 2024 | with llms.txt |
Data source — Yandex.Metrica, “Referral links” report.
I filtered AI chat domains: chatgpt.com, perplexity.ai, chat.deepseek.com, gemini.google.com, chat.qwen.ai, copilot.microsoft.com, alice.yandex.ru.
Read more →