LLMs.txt Generator & Checker

How to use the LLMs.txt Generator & Checker#

1. Enter your website address.
2. Choose Check to test an existing file, or Generate to create a draft.
3. In Check mode, review the structure report and the link test results, then fix any errors in your file.
4. In Generate mode, review the draft, rename sections, remove pages you do not want listed and add short notes that describe each link.
5. Save the final file as llms.txt in the root of your site, so it loads at https://yourdomain.com/llms.txt, then run Check again to confirm it.

Understanding your results#

Check mode#

We fetch /llms.txt and /llms-full.txt from your domain and validate them against the format described in the llms.txt proposal. The proposal describes a markdown file with a predictable structure:

• H1 title. The file starts with a single H1 naming the site or project. This is the only required section in the proposal.
• Blockquote summary. An optional short summary in a markdown blockquote, placed after the H1.
• H2 sections with link lists. Sections headed with H2, each containing a markdown list of links written as - [Title](url): notes, where the notes are optional.
• Optional section. By convention, an H2 section named "Optional" holds secondary links that can be skipped when a shorter context is needed.

We report structure problems such as a missing H1, links that are not written as list items, or sections without any links. We also test a sample of the linked URLs to confirm they actually load, because an llms.txt file full of broken links is not useful to anyone.

Some sites also publish /llms-full.txt, a companion file that contains fuller content in a single document. We report whether that file exists and check it as well.

Generate mode#

We read your homepage title, meta description and the internal links found on your homepage, group those links into sections and produce a draft llms.txt. The homepage title becomes the H1 and the meta description becomes the summary. Treat the draft as a starting point. A homepage rarely links to every important page, and the section names and link notes will read better once you edit them.

How this tool works#

Check mode requests the files over HTTPS, parses the markdown and compares its structure with the proposal. It then requests a sample of the listed URLs and records which ones load successfully. Generate mode fetches your homepage once, extracts the title, meta description and internal links, and arranges them in the proposal's format.

It is worth being clear about what llms.txt is and is not. It is a proposal, not a standard adopted by Google. Google's documentation on AI features says you do not need to create new machine-readable files or AI text files to appear in AI Overviews or AI Mode, and Google has said its search systems do not use llms.txt. Public studies so far have not shown a clear effect on how often sites are cited by AI systems. On the other hand, the file is cheap to create and maintain, and it may help some AI tools that choose to read it. If you publish one, keep it accurate and up to date.

Tips#

• Keep the H1 short and use your real site or product name.
• Write a one- or two-sentence summary that says what the site is and who it is for.
• List your most useful pages, such as documentation, pricing, product overviews and key guides, rather than every URL on the site.
• Add a short note after each link that says what the page covers.
• Put secondary material in the "Optional" section.
• Run Check again after site changes, so moved or deleted pages do not leave broken links in the file.
• Remember that the file does not control crawler access. Crawler rules belong in robots.txt. See how to allow or block AI crawlers.
• Learn more in our guide what is llms.txt.

Frequently asked questions#

What is llms.txt?#

llms.txt is a proposed markdown file placed at the root of a website. It gives AI tools a short, structured overview of the site and links to its most useful pages. It was proposed by Jeremy Howard and is described at llmstxt.org.

Is llms.txt an official standard?#

No. It is a proposal. Google has not adopted it for Search, and Google's documentation says no special AI text files are needed to appear in its AI features.

Does llms.txt improve rankings or AI citations?#

There is no evidence that it improves Google rankings, and public studies so far have not shown a clear effect on AI citations. It may help some AI tools that choose to read it.

Where should I put the llms.txt file?#

In the root of your domain, so it is available at /llms.txt. Make sure it is publicly accessible and not blocked for the crawlers you want to read it.

Does llms.txt block AI crawlers?#

No. It is a guide to your content, not an access control. To allow or block specific crawlers, use rules in your robots.txt file.

How can I see whether AI assistants mention my brand?#

Use the AI Citation Checker, which shows whether your brand is named in the AI answers we archive.