search

duckduckgo / duckduckgo-help-pages

DuckDuckGo Help Pages
https://duckduckgo.github.io/duckduckgo-help-pages/
MIT License
210 stars 209 forks source link

DuckDuckBot IP list as JSON #124

Open StefanTheWiz opened 2 years ago

StefanTheWiz commented 2 years ago

Hi,

I was looking at this help page: https://help.duckduckgo.com/duckduckgo-help-pages/results/duckduckbot/ https://github.com/duckduckgo/duckduckgo-help-pages/blob/master/_docs/results/duckduckbot.md

It would be great if this list of IP addresses could also be consumed as a json endpoint / file so we can ingest it using automation tools, like Terraform.

Thanks ✌️

tayloraswift commented 1 year ago

this would be very helpful to us as well, we currently block all traffic that displays signs of automated behavior, and we would really like to be able to whitelist duckduckbot.

ain commented 11 months ago

Same here. Although User-Agent-based identification is possible, it'd be best to know what IP ranges are used by DuckDuckGo.

Googlebot-like JSON format would be great: https://developers.google.com/static/search/apis/ipranges/googlebot.json

ain commented 11 months ago

Just a note here: considering that DuckDuckBot's IP ranges are up to date, DuckDuckBot seems to use GitHub Actions as 20.12.141.99 is within 20.12.128.0/17, see https://api.github.com/meta