search

chhantyal / py3readiness

Python 3 support graph for most popular packages
http://chhantyal.net/py3readiness
BSD 2-Clause "Simplified" License
159 stars 70 forks source link

PyPi has removed top packages api, use Google BigQuery to get them #53

Closed chhantyal closed 6 years ago

chhantyal commented 6 years ago

Use BigQuery to get data as suggested at https://packaging.python.org/guides/analyzing-pypi-package-downloads/

Alternatively, pypinfo can be used as well.

max-sixty commented 6 years ago

Is this why newer packages aren't showing up? e.g. apache-beam is not listed

hugovk commented 6 years ago

Yes, the old PyPI API was removed in April, which is when this list stopped updating.

See https://github.com/chhantyal/py3readiness/issues/42 for more info.

chhantyal commented 6 years ago

@maxim-lian though I doubit apache-beam is that popular to fall under 360 most popular package.

hugovk commented 6 years ago

apache-beam is at number 208 over the past 365 days, and number 135 over the past 30 days:

https://hugovk.github.io/top-pypi-packages/

anarcat commented 6 years ago

the bigquery API has rate limits when you are not a paying customer (!) which might make this difficult.

hugovk commented 6 years ago

You get free quota which is enough, see https://github.com/chhantyal/py3readiness/issues/42 and https://github.com/chhantyal/py3readiness/pull/51.

chhantyal commented 6 years ago

Fixed in #51 , data is not included in repo. This issue is stale.