opencrawlers

perplexity-user

Perplexity crawler, type: ai assistant.

About this crawler

Fetches pages when Perplexity users ask questions that need web page access.

User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)
robots.txt token
perplexity-user
Respects robots.txt
no
Published IP ranges
https://www.perplexity.com/perplexity-user.json
Operator page
https://docs.perplexity.ai/guides/bots

Including sites that block it only through the * group, 4.23% of all sites with a robots.txt keep it out.

All AI crawlers

What we collect, and how to change your mind