TL;DR: Over two months, agents made roughly 268,000 tracked requests to our site. “AI traffic” turned out to be two very different clients that want opposite things: ChatGPT fetches rendered HTML and essentially never touches Markdown; Claude Code asks for Markdown 76% of the time and gets it through content negotiation. llms.txt, on the other hand, gets fetched almost entirely by bots that aren’t the AI assistants it’s meant for. And the one clever technique we recommended ourselves (the hidden hint for AI) got zero measurable hits.
London based software development consultant
- 78 posts
- 0 comments
Joined 10 months ago
Cake day: September 29th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.























