cohere-ai
Cohere crawler, type: ai training.
- 1,127,199sites name it in robots.txt
- 202,622block it fully (18%)
- 822,260block some paths
- 102,317allow it explicitly
About this crawler
Unconfirmed agent possibly dispatched by Cohere's AI chat products to retrieve internet content in response to user prompts; Cohere has not disclosed its actual purpose.
- User-Agent
Mozilla/5.0 (compatible; cohere-ai; +https://cohere.com/crawler)- robots.txt token
cohere-ai- Respects robots.txt
- yes
- Source (third party, not confirmed by the operator)
- https://knownagents.com/agents/cohere-ai
- Third-party source (Known Agents / Dark Visitors) classifies it as an Undocumented AI Agent; the operator does not confirm it on that page.
- Source says it is expected to follow robots.txt.
- The UA string points to https://cohere.com/crawler, which was not fetched.
Including sites that block it only through the * group, 4.4% of all sites with a robots.txt keep it out.