Closed Marco-Total closed 7 months ago
krypton9208
commented
6 years ago I have the same issue. I run sudo -u www-data php /var/www/nextcloud/occ preview:generate-all and scanned was only first few folders, even not all of admin account and no one of other users.
Marco-Total
commented
6 years ago Hi,
I have solved my problem. The Preview Generator needs a few times to scan realy all folders at first full scan...i have generate a cronjob for the first days: Sudo -u www-daata crontab -e
Cheers, Marco
rullzer
commented
6 years ago Do you actually get errors when scanning? Because we just traverse the whole tree. Also running it multiple times sounds weird. As we should get the same list back each time.
Long story short. What is the output of the command?
ghost
commented
6 years ago I have the same problem.
It looks like this
Scanning folder /maalik/files
Scanning folder /maalik/files/Auto
...
Scanning folder /maalik/files/***/***/MRDONE
The folder MR contained 3 images, one had 45MB. After removing the folder, the task continued a little bit longer
Scanning folder /maalik/files
Scanning folder /maalik/files/Auto
...
Scanning folder /maalik/files/***/***/MR
...
libpng warning: iCCP: known incorrect sRGB profile
libpng warning: iCCP: known incorrect sRGB profile
Scanning folder /maalik/files/***/***/***/***/***DONE
After that, it finishes. But there a lot more folders to do. Doesn't matter, how many times i restart the command, it always finishes at the same point.
matt01
commented
6 years ago I just had the same issue, running a generate-all would stop on the same directory every time I ran it.
The directory is nothing special in my case but I did notice the following error in my nextcloud.log ...
{"reqId":"ruqim6GgDk4jf6ReWyxq","level":3,"time":"2018-01-22T07:37:54+00:00","remoteAddr":"","user":"--","app":"PHP","method":"--","url":"--","message":"Allowed memory size of 134217728 bytes exhausted (tried to allocate 28672 bytes) at \/var\/www\/localhost\/htdocs\/lib\/private\/legacy\/image.php#566","userAgent":"--","version":"12.0.3.3"}
I'm running gentoo, which has different php.ini files for cgi, cli and fpm and the cgi and fpm php.ini files had been set to reasonable values but the cli ini file was at the default 128M.
Changing the ini file and re running the generate-all command has now progressed further then before.
ghost
commented
6 years ago My log shows the same: Allowed memory size of 134217728 bytes exhausted (tried to allocate 24576 bytes) at /volume1/web/nextcloud/lib/private/legacy/image.php#585
@matt01 I have a Synology DS918+. Can you try to describe me, what value I have to put higher? Already set memory_limit to 256M but that didn't work.
Nevermind, I changed it for PHP5.6 while the command was running under PHP7
Works fine now!
ghost
commented
6 years ago I am also experiencing the same issue. Mine appears to jump in leaps and bounds (if pre-generating) and as of late, one file each minute (I execute each minute while trying to troubleshoot the issue).
I was running an encrypted instance so I downloaded all the files via the sync tool and then deleted the old instance, created a new one and then kicked off the preview generation.
Is there anyway to get an advanced log?
Below is the output from a pre-generate. A generate all never moves past the first file it scans.
2018-02-19T22:52:01+00:00 Generating previews for /
JulienDevillers
commented
5 years ago Same for me. I can provide more info on request. Nothing specific on the command line output.
ghost
commented
5 years ago For me the only way was to reduce files over 20mb and the ones bigger were usually created on my Samsung device using the panorama function.
The last file in the log is the problematic one and I just ended up moving them into a separate folder with the .nomedia file.
I had tried a script which hinted that the issue is with the panorama tag on the photo was incorrect l. It didn't work for me as none of the files were detected.
XA21X
commented
5 years ago Seems like this is almost always caused by #108 which can be mitigated by increasing memory_limit. It's been a while, but from what I remember, if a manual execution of preview:generate-all encounters OOM, it will silently exit (not sure if it has a special exit code), giving the impression that it "doesn't scan all folders" etc. Whereas if it was invoked by uploading a new image (and therefore run by a background job - cron), then you might find an error logged in nextcloud.log.
joshtrichards
commented
7 months ago Likely made better via nextcloud/server#22088 for #108.
Since this issue hasn't seen any new traffic in >5 years I'm closing it out. Anyone experiencing this today should create a new issue so it can be evaluated against today's implementation.
Hi,
I have two questions.
When I get the command
sudo -u www-data /var/www/nextcloud/ occ preview:create-all "myuserid"
only the first 83 folders are scanned. In the main directory, however, there are many other subdirectories?
When I get the command
sudo -u www-data /var/www/nextcloud/ occ preview: generate-all
without specifying a userid execution, the scan is performed only for one user. Is this a desired behavior?
Thanks! Marco