Closed hugovk closed 4 years ago
It's worked for the past 2 fortnights (https://github.com/hugovk/top-pypi-packages/commit/2fc66537f71dc577cca1280489f96c0018c2e2a6, https://github.com/hugovk/top-pypi-packages/commit/a987df4b50d1527571ac454ee078ce305131c204) so closing.
Similar to https://github.com/hugovk/top-pypi-packages/issues/3, the data dump is using up too much of the free quota each week
Tail of the logs:
Checking some of the quota used for recent commits, only looking at the 30-day file, shows it increasing quite a lot (most recent first):
https://github.com/hugovk/top-pypi-packages/blob/19c6aabb10d30e21bdf697276cb5a9f067b64f88/top-pypi-packages-30-days.json
https://github.com/hugovk/top-pypi-packages/blob/fb30f944906d2f106232630d405e8d3f09b1fff2/top-pypi-packages-30-days.json
https://github.com/hugovk/top-pypi-packages/blob/a9d318dd3db4041f9afc4d0266be8948d39d1c64/top-pypi-packages-30-days.json
https://github.com/hugovk/top-pypi-packages/blob/da9798a56651a471cf3d1b41948701158a942e18/top-pypi-packages-30-days.json
~1 year back:
https://github.com/hugovk/top-pypi-packages/blob/b8a7d77c98505e4ff5405f345ffd2504367572d4/top-pypi-packages-30-days.json
It's already been reduced from weekly to fortnightly (https://github.com/hugovk/top-pypi-packages/pull/5), let's now reduce the number of packages fetched. Let's first try from 5,000 to 4,000.
The current download counts for packages in positions: