PyPI Infra Incident Impacting BigQuery dataset

crflynn / pypistats.org

PyPI downloads analytics dashboard

https://pypistats.org/

138 stars 10 forks source link

PyPI Infra Incident Impacting BigQuery dataset #68

Closed ewdurbin closed 3 weeks ago

ewdurbin commented 3 weeks ago

Hello! We are tracking an incident that impacted (is impacting?) the BigQuery data sets.

It is evident in the dropoff of stats over the last week. We are currently working to backfill the data, so your stats may need to similarly be backfilled.

I'll leave this issue open for now and notify when we believe we have caught up.

ewdurbin commented 3 weeks ago

Moved from https://github.com/hugovk/pypistats/issues/441

ewdurbin commented 3 weeks ago

There are two phases to our recovery, one is catching up on the backlog of processing and the other is publishing the results to BigQuery.

We're currently in that first phase, and it will take 1-2 days to reprocess the week. More updates on Saturday or Sunday.

bobvanluijt commented 3 weeks ago

Thanks for doing this and keeping the community informed!

ewdurbin commented 3 weeks ago

OK. Our BigQuery dataset is as recovered as we're able. It looks like we lost some data for June 18th unfortunately.

I think downstream users are good to sync their stats now.