AI crawlers, one by one
Who runs each bot, whether it quotes you in answers or only trains on your text, how it identifies itself, and the exact robots.txt line to let it in or shut it out.
- Quotes you in answersOAI-SearchBotChatGPT SearchWhat it is
- Quotes you in answersChatGPT-UserChatGPT (live browsing)What it is
- Training onlyGPTBotOpenAI GPTBotWhat it is
- Training onlyClaudeBotAnthropic ClaudeBotWhat it is
- Quotes you in answersClaude-SearchBotClaude SearchWhat it is
- Quotes you in answersClaude-UserClaude (live browsing)What it is
- Quotes you in answersPerplexityBotPerplexityWhat it is
- Trains and answersGrokBotGrok (xAI)What it is
- Trains and answersGoogle-ExtendedGoogle GeminiWhat it is
- Training onlyApplebot-ExtendedApple IntelligenceWhat it is
- Trains and answersmeta-externalagentMeta AIWhat it is
- Quotes you in answersBingbotCopilot / Bing (feeds many AIs)What it is