Generate your llms.txt
Create a spec-compliant llms.txt file for any website. Help AI systems understand your content structure in seconds.
How it works
Spec compliant
Generates llms.txt files that follow the llmstxt.org specification. Structured sections, proper markdown formatting.
Two modes
Standard mode generates an AI-enhanced index. Detailed mode adds full page content for a comprehensive llms-full.txt.
Automatic categorization
Pages are intelligently grouped into Documentation, API Reference, Guides, Blog, and more based on URL patterns.
Smart discovery
Discovers pages via sitemaps, robots.txt, and BFS crawling. Respects rate limits and crawl delays.