DuckAssistBot

What does DuckAssistBot do?

DuckAssistBot fetches web pages in real time to generate AI-assisted answers within DuckDuckGo Search. These answers prominently cite their sources, giving users direct links back to the originating sites. Allowing this bot can drive referral traffic from DuckDuckGo's AI answer features.

Should I allow and optimize for DuckAssistBot to drive organic growth?

DuckAssistBot directly powers AI-assisted answers in DuckDuckGo Search, and those answers include prominent source citations with clickable links. This is a clear referral traffic channel. DuckDuckGo has a privacy-focused user base that skews toward tech-savvy audiences. Allowing DuckAssistBot means your content can appear as a cited source in these answers, driving clicks from users who are actively searching for information you provide.

Data Usage & Training

Content fetched by DuckAssistBot is not used to train AI models. DuckDuckGo states the data is used solely to generate real-time AI-assisted answers that cite their sources. If you block DuckAssistBot, your content simply won't appear in those answers.

How DuckAssistBot Accesses Content

Here's how DuckAssistBot accesses your site and understands your content:

• Fetches pages in real time via standard HTTP requests when a user query triggers an AI-assisted answer
• Identifies itself with the user-agent string DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)
• Respects robots.txt Disallow and Allow directives for the DuckAssistBot token
• Source IPs are published at https://duckduckgo.com/duckassistbot.json for verification
• Reverse DNS checks may also be used as an additional verification method

On-demand only. DuckAssistBot crawls pages in real time when a user's search query triggers an AI-assisted answer. There is no scheduled or periodic crawling.

How to Block or Control DuckAssistBot

To block DuckAssistBot via robots.txt: User-agent: DuckAssistBot Disallow: / Robots.txt changes take up to 72 hours to take effect. For immediate blocking, filter requests by matching source IPs against the published list at https://duckduckgo.com/duckassistbot.json. You can also contact [email protected] if you experience issues with opt-out.

Common Issues & Troubleshooting

Watch out for these common problems when working with DuckAssistBot:

• Robots.txt changes take up to 72 hours to propagate, so blocking isn't instant
• User-agent string variants may bypass simple string-matching filters; verify against the published IP list instead
• Third-party bot management tools may misclassify DuckAssistBot, either blocking it unintentionally or failing to recognize it
• CloudFlare or similar bot protection services may block DuckAssistBot by default, preventing your content from appearing in AI-assisted answers
• JavaScript-heavy pages may not be fully rendered, so content loaded dynamically could be missed