Open goddib opened 3 years ago
hul51u
commented
3 years ago Sometimes my nextcloud instance has this bug, especially with "new" pictures (nextcloud server hasn't created thumbnails yet). But my server is a nanopi-m4 (4GB ram, Dual Cortex-A72 + Quad Cortex-A53, usb3 ssd, ubuntu server), so I can't complain about that behaviour...
What are your server specs?
yosephsa
commented
3 years ago @goddib Might want to add what version of nextcloud you are running. Also do you have preview provider enabled? like ffmpeg?
skjnldsv
commented
3 years ago Yeah, we added the virtual scroller optimization for Nextcloud 20 :)
- Have 50k .jpg files in a folder with about 108GB total file size
Nonetheless, that many images is indeed crazy. Can you make sure you cleared your cache @goddib ?
Hi! Before we continue, please do the following steps:
occ maintenance:repair on your serverThanks :wink:
goddib
commented
3 years ago Hi all,
thank you for your feedback. First off, my server is a V-Server with 6 cores @2,2 Ghz, 16 GB Ram and 400GB storage. I feel this should be plenty for a single digit user instane of Nextcloud, right?
As of now I am running Nextcloud 20.0.8 on PHP 7.4.15 with all apps up-to-date and a green check-mark in the system overview.
I do not seem to have ffmpeg enabled - that is a PHP module, correct? I understood that is only needed for videos?
I also ran an occ maintenance:repair but without any difference. I can open the "Photos" app without any problem, I get nice previews (although loading slowly) but when I navigate to said folder, Nextcloud becomes unresponsive to a point where I need to close the browser tab (does not react to "reload").
Just as an addition: I am able to open any other folder (with way less pictures) in the app "Photos" without any problem but some delay. Maybe the slow rendering is also what crashes the system in case of the big folder?
I am thankful for any further pointers.
Thanks and cheers goddib
FolkertRA
commented
3 years ago I'd like to second this and say that I am also experiencing this. Tried it last on Nextcloud 20. It runs on a webserver from an external web hosting provider. I don't know the exact specs but Nextcloud system settings says:
CPU: | Intel Core Processor (Broadwell, IBRS) (16 cores) Memory: | 31.26 GB
In my case, I am trying to access ~10.000 photos and some videos, totalling 70gb (most of the size comes from the videos). For a reatively small folder (400 photos, 1gb) it works.
Some suggestions on how this could be resolved (from an end-user perspective that is):
P.S. Thanks for all the development effort, I realize a community-developed solution like this is limited in its resources, I hope this issue can be picked up :).
feanor12
commented
2 years ago I have the same problem with nextcloud 25.0.0.18. Opening the photos app and scrolling to images with low resolution thumbnails makes the server uneesponsive and I get a bad gateway error.
Luticus
commented
2 years ago Same here, this app on nc25 is absolutely murdering my CPU. Just opening the app sends it into overdrive. REALLY wish I could easily limit where this thing looks for photos and other media. I think that would help tremendously. I think it's checking mounted volumes, movie archives and everything. The app is called photos, I just want it to display photos albums, i don't need it to scan my entire instance and import 100,000k files per account.
Luticus
commented
2 years ago To put it into perspective, I disabled the photos app entirely and my instance came back to life. Like 100% speed boost across all other apps.
feanor12
commented
2 years ago Setting 'enable_previews' => false made my server useable again, but it is quite a drastic step.
rarealphacat
commented
1 year ago Having 600k images here and the app never worked for me, It just never loads. NC Photos on the other hand is working fine but it has to be on the phone.
ChildLearningClub
commented
1 year ago Is there some reason that media can not be index into the database like Memories does? I'm not really clear on why either that app has not been integrated better or the features from it have not been carried over to Photos? Is it possibly the sidebar and album creation that slows down Photos? Visually I can not tell what it is doing differently then Memories to slow to a crawl what happens in Memories almost instantly.
Edit: I see that when loading favorites the bottom of the screen shows a spinning loading icon and on the server only a single thread is being used. Is there some reason for only a single thread to be used?
Edit 2: There is also something with Photos that causes me to have multiple of the same favorite photo showing in some cases quadruple, I'm sure contributing to why it's so slow. Memories is not doing this.
rosbeef
commented
1 year ago Is it possible to fix the preview request to some specific sizes ? (not max size)
I think the problem is that the preview automatic creation depend on the browser windows size. If the web page would ask for limited number of thumbnail, they could be generated only one time for each photos, like peviewgenerator do.
I did a script which get the size of the picture asked by the http request and use preview generator to generate thumbnail. But the http request from the web app depend of the browser windows size so i have an infinite number of thumbnail.
paour
commented
1 year ago I have a related issue, where scrolling through photos causes NC to try to generate too many thumbnails at once, leading to an out of memory error that crashes both Apache and MariaDB.
It would make sense to queue thumbnail generation to prevent too many from running at once.
joshtrichards
commented
1 year ago Folks on this thread:
preview_concurrency_* parameters to match your CPU cores/capacity: https://docs.nextcloud.com/server/latest/admin_manual/configuration_server/config_sample_php_parameters.html#preview-concurrency-allpaour
commented
1 year ago Using the preview_concurrency_* settings did lower the RAM usage on my server enough that this is no longer a problem, thanks for the advice.
Describe the bug I have a picture folder with about 50k photos/about 108GB and when I open it in Nextcloud it does not show any thumbnails or react to search/filter. Instead, the system becomes completely unresponsive and I cannot even navigate away while the loading animation shows. Running Nextcloud 20.0.8
To Reproduce Steps to reproduce the behavior:
Expected behavior Photos opens with thumbnails of my photos, I am able to filter/search through them by using the search functionality (.i.e. reduce number of shown pictures)
Desktop (please complete the following information):
Browser log
Additional context This issue has been haunting me ever since I started using nextcloud. will loading large folders like that ever be supported?
Thanks and cheers!