llms.txt, explained
Web pages are full of menus, scripts and layout code. Language models do better with clean text. llms.txt gives them that: a title, a short summary and a list of important links with notes.
It was proposed in 2024 as an open standard. Some sites also publish llms-full.txt, a longer file with the full text of key pages.
It is not a ranking factor in Google, and not every AI tool reads it yet. It is cheap to add, though, and helps tools that do look for it understand your site.
Think of it as a sitemap for AI, written for reading rather than crawling.



