Tools / llms.txt
llms.txt Generator
Describe your site in a few lines, list the pages worth citing, and get a ready-to-publish llms.txt — or import the URLs straight from your sitemap.
llms.txt is a community convention (llmstxt.org), not an official standard, and crawlers support it to different degrees. Place the file at your domain root, next to robots.txt.
What is llms.txt?
llms.txt is a small Markdown file that tells AI crawlers which pages of your site are worth reading, in a shape a language model can consume quickly: an H1 with the project name, a one-line summary, then sections of links with short descriptions. It sits next to robots.txt at the domain root.
How to use this tool
- Fill in the site name, a one-line summary and an optional details paragraph.
- List your pages — Title | URL | description, one per line — or paste a sitemap and import the URLs.
- Copy or download the generated llms.txt.
- Upload it to your domain root and test it with the log analyzer a few days later to see whether AI crawlers request it.
FAQ
Is llms.txt an official standard?
No. It is a proposal published at llmstxt.org and adopted unevenly: some crawlers fetch it, others ignore it. It costs almost nothing to publish, but do not expect it to replace robots.txt or sitemap.xml.
What is the difference between llms.txt and robots.txt?
robots.txt controls access — what crawlers may fetch. llms.txt is a reading guide: given access, these are the pages and the summaries you want quoted. They complement each other.
Do I need a separate file per language?
A single file is the convention. If your site is multilingual, group the links in one section per language and note the language in the description, or publish one file per language section of the site.