search

gauteh / roaring-landmask

A fast and memory-limited landmask based on GSHHG and OpenStreetMap for determing whether a point on Earth is on land or in the ocean.
22 stars 4 forks source link

Wheels too large for pypi: > 100mb #31

Open gauteh opened 1 month ago

gauteh commented 1 month ago

With the OSM landmask (#30 ) the wheels are now too large to be uploaded to pypi (https://github.com/gauteh/roaring-landmask/actions/runs/10826468321/job/30038361665): https://pypi.org/help/#file-size-limit

Can we download the OSM wkb on demand? Otherwise we need to request a larger pypi limit (I did this once before when the limit was lower than 100mb).

ping: @TheSylex

TheSylex commented 1 month ago

The process of converting the shapefile from the OSM website into a WKB is really slow as it's a lot of data... around 4Gb if I'm not mistaken. So I'd assume that yeah, we can do it but I don't think it's a good idea as it'd slow everything down a lot.

gauteh commented 1 month ago

Ok, I guess we should petition to have the limit raised then.

gauteh commented 1 month ago

https://github.com/pypi/support/issues/4748

gauteh commented 1 month ago

Limit is increased, but wheels are not re-enabled yet.