Skip to main content
Visibility Tip Published May 17, 2026

First data: llms.txt is being fetched, but not by AI bots

A look at the Achtung.app server logs reveals a clear pattern: llms.txt does get fetched, but not by the AI bots the file is meant for.

In the 30 days leading up to 17 May 2026, Achtung.app recorded 90 requests for "/llms.txt". The breakdown:

  • 76 requests from a single scraper using a spoofed Chrome user-agent (one IP)
  • 2 requests from the SEO crawler Barkrowler (babbar.tech)
  • 2 requests from our own AchtungBot (internal probes)
  • 2 requests from a spoofed Chrome 86 user-agent, 2 from a spoofed Pixel 6 mobile user-agent
  • 1 request each from AhrefsBot, BuiltWith, Dataprovider and three other profiling user-agents

ClaudeBot, GPTBot, PerplexityBot, OAI-SearchBot, Claude-SearchBot, ChatGPT-User, Perplexity-User, Applebot, Googlebot and Bingbot did not appear in the list once, even though those same bots otherwise hit Achtung.app over 17,000 verified times in the same window.

This lines up with Google's official AI optimization guide: per Google, special files like llms.txt have no effect on AI visibility. The clients fetching the path are classic SEO and discovery crawlers that pick up every documented ".txt" file.

Achtung.app continues to serve an llms.txt as a declarative entry point for agents that explicitly request that path. The file costs nothing and does no harm. It is just not a lever for more AI citations.

Sample: 90 queries Window: 30 days Data source: nginx access logs from achtung.app, 18 April to 17 May 2026. Requesters identified via the User-Agent header on each request. Verified AI bots are sourced from the Achtung.app crawler-verification pipeline (rDNS for Googlebot/Bingbot/Applebot, IP-list matching for ClaudeBot/GPTBot/PerplexityBot). Sample: one domain (achtung.app), 30 days; not necessarily representative of other sites.

Want insights specific to your brand?

Start with a free AI visibility scan and see how your brand performs across AI assistants.

Start Free Scan Get in Touch