chatgpt-user
OpenAI crawler, type: ai assistant.
- 690,278sites name it in robots.txt
- 306,529block it fully (44.4%)
- 108,428block some paths
- 275,321allow it explicitly
About this crawler
Used for user-initiated actions in ChatGPT and Custom GPTs; may visit web pages when users ask questions or use GPT Actions.
- User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot- robots.txt token
chatgpt-user- Respects robots.txt
- no
- Published IP ranges
- https://openai.com/chatgpt-user.json
- Operator page
- https://developers.openai.com/api/docs/bots
- Page says robots.txt rules may not apply because actions are user-initiated.
- Not used for search or automatic web crawling.
Including sites that block it only through the * group, 4.53% of all sites with a robots.txt keep it out.