imagesiftbot
Hive crawler, type: ai training.
- 331,143sites name it in robots.txt
- 197,985block it fully (59.8%)
- 10,603block some paths
- 122,555allow it explicitly
About this crawler
ImagesiftBot scrapes the internet for publicly available images to support Hive's web intelligence products.
- User-Agent
Mozilla/5.0 (compatible; ImagesiftBot; +imagesift.com)- robots.txt token
imagesiftbot- Respects robots.txt
- yes
- Operator page
- https://imagesift.com/about
- Honors crawl-delay as minimum seconds between starts of consecutive requests.
- Follows Googlebot directives if no ImagesiftBot-specific rule exists.
- Opt out via robots.txt or by contacting support@imagesift.com; no IP list published.
Including sites that block it only through the * group, 4.43% of all sites with a robots.txt keep it out.