The Problem:
LLMs are terrible at understanding eCommerce sites. They:
Hallucinate prices/specs from messy HTML
Waste tokens on UI boilerplate (headers, popups, ads)
Struggle with real-time inventory/pricing updates
Our solution: A fork of Answer.AI’s llms.txt that introduces site-llms.xml, an XML sitemap protocol for product data.
Stores expose:
/site-llms.xml: Index of all product URLs
/product/123/llms.txt: Clean Markdown with specs/pricing (example in repo)
Benefits: AI gets structured data instead of scraping Stores control what’s exposed (like robots.txt) Scales to millions of products (sitemap indexes supported)
We’re open-sourcing this under CC BY-SA (same as sitemap protocol).
Would love HN’s thoughts:
Is this the right abstraction? Could it work for non-eCommerce sites?
Repo: github.com/Lumigo-AI/site-llms (stars welcome!)
