3dgeo-heidelberg / pytreedb

Python package providing a file and object-based database to store tree objects.
Other
27 stars 4 forks source link

download of multiple laz files never finishes zipping #122

Open wiesehahn opened 1 year ago

wiesehahn commented 1 year ago

When I try to save selected trees as pointcloud (e.g. for this query) I can see that the data is prepared for download but it takes forever to zip. It works with 4 point clouds but even with 40 it seems to never finish.

Is it necessary to zip these? LAZ files are zipped already and it seems there is not much further compression achieved.

bhoefle-3dgeo commented 1 year ago

Dear @wiesehahn, thanks for your question.

The reason is that if we would serve each file, a prompt to store each file would be opened and you have to (manually) download each single file. You do not want to have that.

This was the reason to "package" them into a single zip file. Undoubtedly, a TAR archive without zipping would also work, but tar is less common outside the Linux world.

For larger file downloads, e.g. for all point clouds e.g. test this permalink, a prompt opens to a text file which includes all URLs of all point clouds. You can either use our provided Python script or wget or similar to download all files automatically.

We can reduce the limit of opening the prompt for bulk downloading, to avoid unhappy users, an limit the direct download only to a few point clouds for which it is fast.

bhoefle-3dgeo commented 1 year ago

For your query, the bulk option is now opened. I hope this explains and resolves your issue.