sidetrade indexer bot
Sidetrade crawler, type: ai training.
- 77,535sites name it in robots.txt
- 40,427block it fully (52.1%)
- 5,612block some paths
- 31,496allow it explicitly
About this crawler
Uncategorized agent with unclear purpose.
- User-Agent
Sidetrade indexer bot- robots.txt token
sidetrade indexer bot- Respects robots.txt
- yes
- Source (third party, not confirmed by the operator)
- https://knownagents.com/agents/sidetrade-indexer-bot
- Third-party source (Known Agents); operator Sidetrade does not confirm.
- Source states the operator is not identified and says the bot is 'expected to follow robots.txt rules' with no established profile.
- Source reports 9% of top websites block it as of October 6, 2026.
Including sites that block it only through the * group, 4.23% of all sites with a robots.txt keep it out.