perplexity-user
Perplexity crawler, type: ai assistant.
- 146,148sites name it in robots.txt
- 46,930block it fully (32.1%)
- 43,056block some paths
- 56,162allow it explicitly
About this crawler
Fetches pages when Perplexity users ask questions that need web page access.
- User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)- robots.txt token
perplexity-user- Respects robots.txt
- no
- Published IP ranges
- https://www.perplexity.com/perplexity-user.json
- Operator page
- https://docs.perplexity.ai/guides/bots
- Page: since a user requested the fetch, this fetcher generally ignores robots.txt rules.
Including sites that block it only through the * group, 4.23% of all sites with a robots.txt keep it out.