Definition

Crawlers that fetch web content, e.g. GPTBot, PerplexityBot, ClaudeBot. Allowing them is a prerequisite for being cited.