Free · No sign-up required

AI bot access checker

For AI assistants to read your site and recommend it in their answers, you need to allow their crawlers. See the permissions of 14 AI crawlers in one click.

We read robots.txt, llms.txt and the robots tags on your homepage.

Why it matters

Assistants like ChatGPT, Claude and Perplexity read the web with their own crawlers when answering. If your robots.txt blocks these crawlers, your site can’t be cited as a source in their answers.

Some crawlers are only for model training (e.g. GPTBot, Google-Extended); others are for live search and user requests (OAI-SearchBot, ChatGPT-User, PerplexityBot). Blocking training bots while allowing search bots is a common, balanced choice.

  • Permission status for each AI crawler in robots.txt
  • Separation of search, user-request and training bots
  • Presence and size of the llms.txt file
  • noai / noimageai and X-Robots-Tag directives on the page

Frequently asked questions

What is llms.txt?
llms.txt is a proposed file format that lists your site’s most important pages and a short summary in a simple form AI models can read. You can create one in seconds with our free llms.txt generator.
Does blocking AI bots affect SEO?
As long as you don’t block Googlebot, your Google rankings aren’t affected. But blocking search-oriented AI bots makes it less likely that your site is cited as a source in ChatGPT or Perplexity answers.
Why doesn’t Google-Extended show up as a visitor?
Google-Extended and Applebot-Extended are robots.txt tokens; the site is crawled by the regular Googlebot and Applebot. These tokens only allow or block the use of your content in AI models.

Other free tools

AI visibility checkDo ChatGPT and Perplexity recommend you?Popular AI readiness testYour site’s AI readiness in 10 questions llms.txt generatorSummarize your site for AI assistants How does AI see your page?Text view without JavaScript and AI access SEO analysis80+ checks, category scores and prioritized recommendationsPopular SEO site auditTechnical and on-page checks for up to 15 pagesPopular

All free tools

See where your site stands in 20 seconds.

Find your technical issues and AI visibility gaps with a free analysis, then leave the fixing to AutoAiSeo.

  • No card required
  • 5-minute setup
  • Cancel anytime
Analyze for free