What is llms.txt?
llms.txt is an emerging convention - similar in spirit to robots.txt - that gives AI assistants and LLM-based
tools a clean, structured markdown summary of your site: what it is, and links to your most important pages,
without needing to crawl and parse your full HTML. Fill in your site name, a one-line summary, and the key
pages you want AI tools to know about, then publish the result at /llms.txt on your domain
root.
Why this uses plain markdown links rather than any more complex structured format
The llms.txt convention is deliberately simple: a markdown heading, an optional summary line, and a bulleted list of links with short descriptions - a format any language model can parse easily without needing a dedicated schema or JSON structure, which is exactly the point of the convention existing at all.
Why you choose which pages to list rather than the tool crawling your whole site
The convention's value comes specifically from curation - a short, deliberately chosen list of your most important pages gives an AI tool a focused starting point, while an automatically generated list of every page on a large site would recreate the exact crawling and parsing problem llms.txt exists to avoid.
Why this is worth publishing even though it isn't an official, universally adopted standard yet
The convention is still community-proposed rather than formally standardized, and adoption among AI systems varies - but because generating and publishing the file costs nothing and takes a few minutes, there's little downside to having one in place for the AI tools that do already support it, while the format continues to gain broader adoption.