llms.txt

llms.txt is an emerging convention (like robots.txt, but for AI) — a plain-text index at the root of your site that tells answer engines what you are and points them at your key pages. AskThis generates one for you from the onboarding scan, so you don’t have to hand-write or maintain it.

The endpoints

Both are public, text/plain, and edge-cacheable — link them from your site so crawlers can consume them:

# Index: site summary + a curated list of key pages
curl https://api.askthis.io/api/v1/sites/cq_8f2a/llms.txt

# Full: the index plus an inlined one-line summary of each page
curl https://api.askthis.io/api/v1/sites/cq_8f2a/llms-full.txt

The content is built from your scanned pages (title, URL, page type and the AI Graph summary of each), following the llmstxt.org format: an H1 site name, a short description, then sections of links.

Serving it

Point your site’s /llms.txt at the generated file. Two common ways:

• Proxy / redirect https://yoursite.com/llms.txt to the AskThis endpoint above (it’s cache-friendly).
• Snapshot the output into a static file you deploy, and refresh it after big content changes.

Because the file is generated from the same scan that writes your prompts and AI Graph tags, keeping your scan current keeps all three in sync.

Why it matters

llms.txt and AI Graph tags are complementary: the tags tell an engine how to read a page it already landed on; llms.txt helps it discover which pages to read in the first place. Together they remove the guesswork from how AI represents your site.