rust-lang / crates.io

The Rust package registry
https://crates.io
Apache License 2.0
2.93k stars 596 forks source link

Cloudfront cache not cleared for database dumps with Accept-Encoding request headers #6977

Open LawnGnome opened 1 year ago

LawnGnome commented 1 year ago

Not trying to bump a closed issue thread, but I'm also not sure if this is related. I'm being served a stale version of the dump when I don't provide a Accept-Encoding header: image

Setting Accept-Encoding to gzip, deflate, br grabs me the new data, but I'm actually not sure if that's just related to how cloudfront is caching the request.

Is there any way around cloudfront's cache or should I just expect to possibly have ~48-hour stale data?

Originally posted by @enricozb in https://github.com/rust-lang/crates.io/issues/6652#issuecomment-1676432689

(opening per @jdno's suggestion)

enricozb commented 1 year ago

There were some questions about reproduction, and I can still reproduce this today: image

In case it matters (for cache invalidation propagation or something) I'm in Honolulu Hawaii.

jdno commented 1 year ago

Thanks for clarifying, @enricozb! I might've confused the output from production and staging, I see the same as you when testing again. My bad.