Free Tool | Public-Site Diagnostic

AI Crawler Access Checker

Paste your domain and check whether major AI and search crawlers can read the public site.

  • Checks GPTBot, Google-Extended, PerplexityBot, CCBot, and Googlebot
  • Checks robots.txt, sitemap.xml, homepage access, and key context signals
  • No login, analytics access, or paid model call required

Run The Check

Check the homepage domain

Use the main website URL. The tool normalizes it and checks the public root, not a deep page.

Scope: public homepage, robots.txt, sitemap.xml, and a few homepage context signals. This does not measure actual AI recommendation share.

Why this matters

Blocked access is fixable. Open access only rules out one problem.

  • Blocked bots can make your site look stale or incomplete to AI systems.
  • Partial restrictions are common and often accidental.
  • If access looks healthy, the next question is whether AI buyers actually recommend you.

Tool FAQ

Common questions about this check

Short answers to the questions that usually come up after the first scan.

What does “restricted” mean?

Restricted means the bot is not fully blocked, but robots.txt still disallows important paths. The site may still be partly readable, but access is not fully open.

If robots.txt is missing, is my site open?

Usually yes. A missing robots.txt file generally means public crawling is open unless the site is blocked another way.

Does open crawler access guarantee AI visibility?

No. Open access only removes one source of technical friction. AI can still skip a business when profile accuracy, page clarity, reviews, schema, or other trust signals are weak.

Do I need Search Console or analytics to use this tool?

No. This tool only checks public pages and public files like robots.txt and sitemap.xml.

What should I do if crawlers are allowed but AI still does not mention my business?

That is where the full Geo It Is audit is useful. We test buyer questions and connect the result to likely causes like weak business details, thin pages, low review freshness, or other trust gaps.