search

dasch-swiss / sipi

Simple Image Presentation Interface
https://sipi.io
GNU Affero General Public License v3.0
32 stars 8 forks source link

Subdir max level #183

Open subotic opened 7 years ago

subotic commented 7 years ago

I just tried to start sipi with subdir_levels = 6. It is already running over 60 minutes and this is with only a few test images. I don't think that 6 is necessary.

As an example, with 5 levels, we already have over 11 million folders. If we have only one file per folder and each file is only 10MB in size, then we have already over 100 TB of data.

With 6 levels we have over 300 million folders and around 2.8 PB of data and other problems.

I would suggest a maximum of 5 if not 4.

subotic commented 7 years ago

After 90 minutes I gave up.

lrosenth commented 7 years ago

I totally agree and would even suggest max level = 3

Von meinem iPhone gesendet

Am 30.06.2017 um 15:08 schrieb Ivan Subotic notifications@github.com<mailto:notifications@github.com>:

After 90 minutes I gave up.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/dhlab-basel/Sipi/issues/183#issuecomment-312262443, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFN9zJp3cs21lQNa523d4hyiiy8Ms2Fiks5sJPMlgaJpZM4OKgMP.

subotic commented 7 years ago

ok, thanks. I will add the checks and limit to 3.