# llms.txt and robots.txt: giving AI crawlers clear instructions without blocking citations

Two small files can shape how assistants read your site.

robots.txt says which paths crawlers may fetch. Blocking everything keeps content out of AI answers as well as training sets; decide on purpose which bots you allow.

llms.txt is a proposed plain-text file that lists your most useful pages with one-line descriptions, so a model can find the right source quickly. It is not a standard that every engine follows, so treat it as a cheap extra, not a ranking lever.

What to include: your facts page, pricing explainer, top guides and contact page. Keep descriptions factual.

Both files should be reviewed whenever you restructure the site. For the full workflow see GEO optimization in 10 steps.

By PandaWM — a Hong Kong team helping overseas-facing companies with GEO / AI search visibility, Facebook, TikTok and Google ads, multilingual websites, AiChatSale and a crypto payment gateway for overseas merchants (the company holds an MSB license).