Cisco-Talos / clamav

ClamAV - Documentation is here: https://docs.clamav.net
https://www.clamav.net/
GNU General Public License v2.0
4.19k stars 684 forks source link

FreshClam received error code 429 from the ClamAV Content Delivery Network (CDN) #983

Open Sanket-Limbekar opened 1 year ago

Sanket-Limbekar commented 1 year ago

Gettting below error post restart of GKE pods,

2023-07-29 18:17:45.267 IST Sat Jul 29 12:47:45 2023 -> ^You are on cool-down until after: 2023-07-29 16:47:45 2023-07-29 18:17:45.267 IST Sat Jul 29 12:47:45 2023 -> main database available for download (remote version: 62) 2023-07-29 18:17:45.325 IST Sat Jul 29 12:47:45 2023 -> ^Can't download main.cvd from https://database.clamav.net/main.cvd 2023-07-29 18:17:45.325 IST Sat Jul 29 12:47:45 2023 -> ^FreshClam received error code 429 from the ClamAV Content Delivery Network (CDN). 2023-07-29 18:17:45.325 IST Sat Jul 29 12:47:45 2023 -> This means that you have been rate limited by the CDN.

The pods are not able to download the main.cvd.

Could you please suggest solution ?

micahsnyder commented 1 year ago

We enforce rate limiting to limit how often people download the signature databases as the are quite large and so it costs us quite a bit to host them.

Unfortunately our rate limiting mechanism is not working as intended as is overzealous -- which is primarily affecting people running clamav in big public cloud environments. Our web team will be working with Cloudflare engineers to tune it to work the way we want, but I'm not sure when they'll fix it.

The best option, regardless, is if you can store the signature databases in a shared volume that you mount into your pods. This way when they start up they already have the databases, and you only need to update the databases in that volume once instead of updating copies in each pod with every start.

pawol commented 1 year ago

To be honest I use this NAS in a small home network behind a router and only NAS uses Clamav so it is not possible to generate "over" traffic to your CDN.