Search and indexing

Be found and quoted by AI search: llms.txt, Markdown copies and crawler rules

Switch on llms.txt and Markdown copies, write your one-line summary, decide which AI crawlers may read your site, and see which bots visit.

AI assistants such as ChatGPT, Claude, Perplexity and Gemini read the web to answer questions. These files give them a clean way in. No AI provider promises to use them, so think of this as making it easy, not as a guarantee.

Step 1: give AI a clear map

1. Open OnlyAI SEO, AI Visibility.
2. Under 1. Give AI a clear map of your site, keep these on: llms.txt (a short Markdown index of your best content), llms-full.txt (the full text of your top articles in one file) and Markdown copy of every post (your-post.md, announced in each page head).
3. Fill in the One-line summary: who you are and what you cover, in plain words. This is the first thing an AI reads about your site.
4. Optionally add Extra context: audience, expertise, how to cite you, topics you do not cover.
5. Press Test llms.txt to open the live file.

Markdown copies only include published, unprotected posts that are not marked noindex.

Step 2: choose which AI crawlers may read your site

The table lists crawlers in two groups. Ticking a box blocks that crawler in robots.txt. Leave everything unticked to allow all of them (recommended for visibility).

• Answer engines (OAI-SearchBot, PerplexityBot and similar) decide whether you are cited in answers. Blocking them means you will be cited less.
• Training crawlers collect text to train models. Blocking them does not affect Google or Bing rankings.

If you have a real robots.txt file in your site folder, WordPress cannot add these rules; the page warns you. See robots.txt the safe way.

Step 3: watch the visits

The page logs visits from AI crawlers. Visits to cached pages are served by your cache and not seen, so the counts are a minimum. Requests for llms.txt and .md files are always counted.

Make posts easy to quote

• Put a clear definition or answer near the top.
• Use numbers with a source, and question-style headings with a short direct answer. The AI Search tab in the editor sidebar shows tips per post.
• The AI Visibility agent checks the whole site and names up to three high-earning posts that are hardest to quote, with the exact checks that fail. Inbox guide.