how do i write an llms.txt file for my site?
Write an llms.txt file as a markdown document at your domain root listing your most important URLs grouped by section, each with a one-line description. Start with an H1 brand name, an italic blockquote summary, then H2 sections like Documentation, Products, and Blog. Under each section, list URLs as markdown links with descriptions. Keep total file size between 10KB and 100KB for reliable ingestion. Validate by fetching with curl and reviewing structure against the official llmstxt.org specification published by Jeremy Howard.
Evidence and detail
- The llms.txt specification was published by Jeremy Howard at llmstxt.org in September 2024 as an open community standard.
- Standard file structure: H1 brand name, italic summary blockquote, H2 sections with markdown link lists and short descriptions.
- Reliable ingestion size sits between 10KB and 100KB per file; larger files often truncate during AI crawler retrieval.
- Anthropic, Stripe, and FastAPI publish reference llms.txt files at their domain roots as practical implementation examples.
Related reading
Other buyer questions
- how do i get my site cited by chatgpt search in 2026?
- what are the ranking factors for perplexity in 2026?
- what sources does claude actually cite when it answers questions?
- how does google ai mode decide which sources to show?
- why does bing matter so much for ai search optimization?
- what is the difference between llms.txt and llms-full.txt?
- how should i configure robots.txt for ai bots in 2026?
- what schema markup do i need for ai search citations?
Browse all buyer questions → Industry playbooks → Competitor comparisons →