Can AI
read your site?
We read your robots.txt bot by bot and request your site with each crawler's name, the way it would. That also shows what robots.txt doesn't tell you: a firewall or CDN turning them away.
This is one piece. The analysis looks at all of them.
In 30 seconds we compare what a person sees on your site with what an AI crawler receives, give you a score and tell you what to fix first. The analysis is free.
Analyze my site for freeQuestions
What's the difference between blocking in robots.txt and the server “turning it away”?
robots.txt is a polite request: the bot reads it and chooses to comply. Being turned away is different: your firewall, your CDN (Cloudflare, for example) or a security plugin answers 403 or 429 even though robots.txt lets it in. You can't see that by reading robots.txt, and it's very common.
If I block GPTBot, do I disappear from ChatGPT?
No. GPTBot only collects text to train models. ChatGPT's searches use OAI-SearchBot and ChatGPT-User. You can block GPTBot and still appear in answers.
Why does Google-Extended show up if it isn't a real bot?
Google-Extended makes no requests of its own: it's a name that only exists in robots.txt to decide whether Gemini uses your site. We check it in robots.txt and with what your server returns to Googlebot.
Do you store the site I check?
No. This check isn't stored and creates no report. The requests to your site only happen while you wait.
More tools
- Does AI recommend you?We ask an AI what your customer would ask and show you who it recommends: you or your competitors.Use it
- What AI understands about your siteYour business described by an AI that has only read what your site sends it. What it doesn't know, in red.Use it
- What's your domain worth?A price range for any domain, with real sales of similar domains and its age in the registry.Use it
- robots.txt generatorChoose which AI bots can read you and which can't train on your site, and copy the block.Use it