iaskspider
iAsk crawler, type: ai search.
- 94,168sites name it in robots.txt
- 56,161block it fully (59.6%)
- 5,857block some paths
- 32,150allow it explicitly
About this crawler
Undocumented AI agent that crawls websites without disclosing its purpose, collecting data for an unknown AI use case.
- User-Agent
iaskspider/2.0- robots.txt token
iaskspider- Respects robots.txt
- yes
- Source (third party, not confirmed by the operator)
- https://knownagents.com/agents/iaskspider
- Third-party source (Known Agents, formerly Dark Visitors); operator iAsk does not confirm.
- Source lists operator as 'Ai Search', country United States.
- Source says 'expected to follow robots.txt rules', not verified by the operator.
Including sites that block it only through the * group, 4.25% of all sites with a robots.txt keep it out.