opencrawlers

duckassistbot

DuckDuckGo crawler, type: ai search.

About this crawler

Crawls pages in real time for DuckDuckGo's AI-assisted answers, which cite their sources.

User-Agent
DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)
robots.txt token
duckassistbot
Respects robots.txt
yes
Published IP ranges
https://duckduckgo.com/duckassistbot.json
Operator page
https://duckduckgo.com/duckduckgo-help-pages/results/duckassistbot/

Including sites that block it only through the * group, 4.23% of all sites with a robots.txt keep it out.

All AI crawlers

What we collect, and how to change your mind