psincraian / pepy

pepy is a site to get statistics information about any Python package.
https://pepy.tech
MIT License
796 stars 33 forks source link

Pepy down (26.11.2021) #391

Closed RobWen closed 2 years ago

RobWen commented 2 years ago

Projects stats are down again ? Well I cannot imagine that only 8k people downloaded pandas in the last day

Can we help somehow?

Ankit404butfound commented 2 years ago

I am also seeing this issue, I wanted to check the statistics of pywhatkit but it's exceptionally low. Screenshot_2021-11-28-08-58-11-59.

hugovk commented 2 years ago

This is also affecting other projects (https://github.com/crflynn/pypistats.org/issues/44) and appears to be an upstream problem: https://github.com/pypa/linehaul/issues/61

hugovk commented 2 years ago

It's this:

We've identified an issue with the PyPI download statistics documented at https://packaging.python.org/guides/analyzing-pypi-package-downloads/ not updating. A resource quota with our backend providers has been exceeded and we are looking into how to resolve the issue. It may be some time before this can be addressed, but statistics in the meantime should be recoverable.

https://status.python.org/incidents/2jj696st6yn5.

psincraian commented 2 years ago

Thanks @hugovk, seems that you are right :-)

venaturum commented 2 years ago

Update from link provided by @hugovk

We have begun the process of rearchitecting our data processing pipeline to get below the quotas that are impacting and should begin loading the backlog of data and processing new incoming over the next few days.

Posted Nov 30, 2021 - 20:35 UTC

mpenning commented 2 years ago

over the next few days.

FYI, eight days later I can confirm that stats for these projects still appear to be broken...

cc: @ktbyers, @dbarrosop, @fooelisa

edgarriba commented 2 years ago

Same for some pytorch related

RobWen commented 2 years ago

It is still open https://status.python.org/ No need to post every not working project now...

ewdurbin commented 2 years ago

Just finished resolving our data pipeline issues, but crucially you should migrate to consuming from the bigquery-public-data dataset rather than the-psf, and reprocess 2021-11-23 as well as all days since to get the most accurate data. we will likely not be backfilling the the-psf dataset.

seanlaw commented 2 years ago

Thank you for the update @ewdurbin!

psincraian commented 2 years ago

Thanks for the update @ewdurbin, I will update the code and backfill the data

psincraian commented 2 years ago

All the data is now backfilled :-)