perplexitybot
Perplexity crawler, type: ai search.
- 600,248sites name it in robots.txt
- 173,400block it fully (28.9%)
- 97,811block some paths
- 329,037allow it explicitly
About this crawler
Designed to surface and link websites in Perplexity search results; not used to crawl content for AI foundation models.
- User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)- robots.txt token
perplexitybot- Respects robots.txt
- yes
- Published IP ranges
- https://www.perplexity.com/perplexitybot.json
- Operator page
- https://docs.perplexity.ai/guides/bots
- Sites should explicitly allow it for search result inclusion.
Including sites that block it only through the * group, 4.35% of all sites with a robots.txt keep it out.