psincraian / pepy

pepy is a site to get statistics information about any Python package.
https://pepy.tech
MIT License
781 stars 33 forks source link

PyPI Infra Incident Impacting BigQuery dataset #679

Closed ewdurbin closed 2 months ago

ewdurbin commented 2 months ago

Hello! We are tracking an incident that impacted (is impacting?) the BigQuery data sets.

It is evident in the dropoff of stats over the last week. We are currently working to backfill the data, so your stats may need to similarly be backfilled.

I'll leave this issue open for now and notify when we believe we have caught up.

psincraian commented 2 months ago

Thanks for the headsup @ewdurbin ☺️

ewdurbin commented 2 months ago

There are two phases to our recovery, one is catching up on the backlog of processing and the other is publishing the results to BigQuery.

We're currently in that first phase, and it will take 1-2 days to reprocess the week. More updates on Saturday or Sunday.

ewdurbin commented 2 months ago

OK. Our BigQuery dataset is as recovered as we're able. It looks like we lost some data for June 18th unfortunately.

Screenshot 2024-06-22 at 8 25 28 AM

I think downstream users are good to sync their stats now.