coreos / fedora-coreos-cincinnati

Backend for Fedora CoreOS auto-updates (Cincinnati server)
Other
12 stars 16 forks source link

scraper: lower connection idle timeout #20

Closed lucab closed 4 years ago

lucab commented 4 years ago

This lowers the idle timeout on reqwest connection pool so that it is lower than the S3/Cloudfront idle timeout (20s). It should help avoiding races with the server closing an idle connection in the pool, which at the same time has been selected for sending the next request.

Ref: https://aws.amazon.com/premiumsupport/knowledge-center/s3-socket-connection-timeout-error/

lucab commented 4 years ago

/cc @zonggen