Operations // Articles

What Is llms.txt?

A practical explanation of llms.txt, where to place it, how to structure it, and what to check before publishing.

llms.txt is a Markdown text file placed at the root of a site. Unlike sitemap.xml, which is mainly for search crawlers, llms.txt is a compact guide that helps LLMs and AI agents understand the important pages, docs, and context of a site.

A focused guide for AI agents

Navigation, footers, article archives, and XML sitemaps all describe a site in different ways. They are not always the shortest path for an AI agent to understand what matters. llms.txt lets you list the pages that are useful to read first, grouped under simple Markdown headings.

Basic structure

A practical llms.txt starts with an H1 for the site name, a short blockquote summary, and sections such as Core, Docs, and Optional. Each important page is written as a Markdown link, optionally followed by a short explanation.

# Example Site

> A short description of what this site provides.

## Core

- [Home](https://example.com/): Main entry point
- [Tools](https://example.com/tools): Tools available on the site

## Optional

- [Articles](https://example.com/articles): Supporting articles and guides

What to check

  • The file is published at /llms.txt
  • The first visible content is an H1 that identifies the site
  • The summary is short and accurate
  • Important links are grouped into sections
  • Old, private, or staging URLs are not included
  • Link descriptions match the actual page content

The TOOLPOOL llms.txt Generator helps create a file from editable templates. After publishing, the llms.txt Checker can confirm that the file is fetchable and that the basic structure is readable.

References