research-software-directory / RSD-as-a-service

This repo contains the new RSD-as-a-service implementation
https://research.software
22 stars 15 forks source link

Replace or remove PyPI download counts scraper #1037

Open ewan-escience opened 8 months ago

ewan-escience commented 8 months ago

To scrape PyPI download counts, we use https://api.pepy.tech/. However, that API now requires an API key for all requests to it, rendering our scraper unusable (and generating a lot of errors). We could either

See also https://packaging.python.org/en/latest/guides/analyzing-pypi-package-downloads/

jmaassen commented 8 months ago

Would downloading the dataset be an option? If so we could analyze it ourselves. It would be good to do this on free infrastructure though, like DAS6 or so.