Knowledge Base

Get Expert Website Hosting

Choose website reliability and expertise with SiteGround!

Home / Website Help / List of Allowed AI Crawlers on SiteGround Servers

List of Allowed AI Crawlers on SiteGround Servers

Last update: Aug 28, 2025

The following user chat session crawlers are allowed on our servers:

OpenAI

  • ChatGPT-User
  • OAI-SearchBot

Anthropic

  • Claude-User
  • Claude-SearchBot
  • Claude-Web

Google

  • CloudVertexBot
  • GoogleAgent-Mariner
  • Gemini-Deep-Research

Perplexity

  • Perplexity-User
  • PerplexityBot

Clients who do not want their content visible in AI chat answers can still block these crawlers manually via .htaccess.

Share this article

Related Articles