search

YunoHost-Apps / pixelfed_ynh

The federated image shareing service Pixelfed for YunoHost
https://pixelfed.org/
GNU Affero General Public License v3.0
43 stars 15 forks source link

Import fails half-way: thumbsnails are shown for selection, but pictures are blank after import #240

Open Zeitverschreib opened 10 months ago

Zeitverschreib commented 10 months ago

Pixelfed 0.11.9~ynh2 Yunohost 11.2.4

I tried to import an Instagram zip. All pictures are shown for selection, but after import the file/s are blank, "No Preview Available".

Dates and additional info texts are imported correctly.

lapineige commented 10 months ago

For reference, this is a known issue : https://forum.yunohost.org/t/pixelfed-0-11-9-instagram-import-no-preview-after-import/26071/

We are waiting for advices from Pixelfed projet on how to solve this : https://github.com/pixelfed/pixelfed/issues/4275#issuecomment-1689900114

A temporary workaround is to force an upgrade to the same version: yunohost app upgrade pixelfed --force.

Before doing that, can you share the result of : ls -l /var/www/pixelfed/public/storage/m/_v2/* namei -l /var/www/pixelfed/public/storage/m/_v2/ cat /etc/php/8.2/fpm/pool.d/pixelfed.conf

Zeitverschreib commented 9 months ago

The forced upgrade did not solve the problem.

Here are the results of the three commands:

root@zwoelfdreifuenfundvierzig:/home/admin# ls -l /var/www/pixelfed/public/storage/m/_v2/*

/var/www/pixelfed/public/storage/m/_v2/428947132208586753:

insgesamt 60

drwxr-x--- 16 pixelfed www-data 4096 24. Feb 2023 0fca8ea69-e1c06b

drwxr-x--- 27 pixelfed www-data 4096 29. Mai 2022 135f62a6c-a5d387

drwxr-x--- 29 pixelfed www-data 4096 30. Jun 19:22 186f813ba-297a89

drwxr-x--- 32 pixelfed www-data 4096 30. Jun 2022 2f76a232a-f08599

drwxr-x--- 19 pixelfed www-data 4096 29. Jan 2023 3079cad20-917577

drwxr-x--- 5 pixelfed www-data 4096 11. Aug 2022 3c6c7d1ab-ede048

drwxr-x--- 9 pixelfed www-data 4096 19. Mär 15:54 42a8ecf32-5a8865

drwxr-x--- 7 pixelfed www-data 4096 3. Jul 2022 7a6475c83-a44db4

drwxr-x--- 3 pixelfed www-data 4096 26. Dez 2022 8d46c944c-26de5d

drwxr-x--- 8 pixelfed www-data 4096 23. Sep 2022 95653d066-30298e

drwxr-x--- 12 pixelfed www-data 4096 30. Apr 20:52 9e2db7367-e375b7

drwxr-x--- 15 pixelfed www-data 4096 30. Jul 15:58 bf0f52ff2-92677b

drwxr-x--- 112 pixelfed www-data 4096 24. Aug 22:20 c51ea9690-856390

drwxr-x--- 35 pixelfed www-data 4096 29. Mai 14:50 c537ce87c-f5971d

drwxr-x--- 9 pixelfed www-data 4096 9. Sep 11:44 ea59ea880-d2aad0

/var/www/pixelfed/public/storage/m/_v2/557608242228323015:

insgesamt 8

drwxr-x--- 4 pixelfed www-data 4096 29. Apr 19:47 9e2db7367-e375b7

drwxr-x--- 10 pixelfed www-data 4096 22. Mai 20:15 c537ce87c-f5971d

/var/www/pixelfed/public/storage/m/_v2/571411042980422652:

insgesamt 12

drwxr-x--- 13 pixelfed www-data 4096 12. Jun 19:13 186f813ba-297a89

drwxr-x--- 6 pixelfed www-data 4096 24. Jul 15:17 bf0f52ff2-92677b

drwxr-x--- 5 pixelfed www-data 4096 2. Aug 17:35 c51ea9690-856390

root@zwoelfdreifuenfundvierzig:/home/admin# namei -l /var/www/pixelfed/public/storage/m/_v2/

f: /var/www/pixelfed/public/storage/m/_v2/

drwxr-xr-x root root /

drwxr-xr-x root root var

drwxr-xr-x root root www

drwxr-x--- pixelfed www-data pixelfed

drwxrwx--- pixelfed www-data public

lrwxrwxrwx pixelfed www-data storage -> /var/www/pixelfed/storage/app/public

drwxr-xr-x root root /

drwxr-xr-x root root var

drwxr-xr-x root root www

drwxr-x--- pixelfed www-data pixelfed

drwxrwx--- pixelfed www-data storage

drwxrwx--- pixelfed www-data app

drwxrwx--- pixelfed www-data public

drwxrwx--- pixelfed www-data m

drwxrwx--- pixelfed www-data _v2

root@zwoelfdreifuenfundvierzig:/home/admin# cat /etc/php/8.2/fpm/pool.d/pixelfed.conf

[pixelfed]

user = pixelfed

group = www-data

chdir = /var/www/pixelfed

listen = /var/run/php/php8.2-fpm-pixelfed.sock

listen.owner = www-data

listen.group = www-data

pm = ondemand

pm.max_children = 16

pm.max_requests = 500

request_terminate_timeout = 1d

pm.process_idle_timeout = 10s

; Additional php.ini defines, specific to this pool of workers.

php_admin_value[upload_max_filesize] = 100M

php_admin_value[post_max_size] = 100M
lapineige commented 9 months ago

The forced upgrade did not solve the problem.

Ok that means we have a new problem…

Here are the results of the three commands

Before or after the upgrade ?

They seems ok… Except there is no "september 2023" or similar, so no new picture created recently ? :thinking:

Zeitverschreib commented 9 months ago

Before the upgrade.

The latest post was on 09/09:

https://pixelfed.zwoelfdreifuenfundvierzig.net/i/web/post/606059709323246978

This is the result of today's import attempt:

https://pixelfed.zwoelfdreifuenfundvierzig.net/i/web/post/1000002120701220

lapineige commented 9 months ago

Before the upgrade.

Ok, so at least the permission issue didn't reappear.

The latest post was on 09/09:

My bad, I didn't read it correctly.

Can you share the result of ls -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/* please ?

Zeitverschreib commented 9 months ago 
root@zwoelfdreifuenfundvierzig:/home/admin# ls -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/*
/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh:
insgesamt 120
-rw-r--r-- 1 pixelfed www-data 119069 11. Sep 19:00 bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/BpwmGqqQ63kr:
insgesamt 520
-rwxr-x--- 1 pixelfed www-data 442529  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp.jpg
-rwxr-x--- 1 pixelfed www-data  82358  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/dIKte5MiNgnr:
insgesamt 1316
-rwxr-x--- 1 pixelfed www-data 1095621  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj.jpg
-rwxr-x--- 1 pixelfed www-data  249582  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/DQ6A7QpuV5Oh:
insgesamt 840
-rwxr-x--- 1 pixelfed www-data 615820  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO.jpg
-rwxr-x--- 1 pixelfed www-data 241578  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ibCLTLeuezBA:
insgesamt 1416
-rwxr-x--- 1 pixelfed www-data 1074732  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks.jpg
-rwxr-x--- 1 pixelfed www-data  368745  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ihi6kukMhtqQ:
insgesamt 0

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/mIB5E9tiTsus:
insgesamt 1656
-rwxr-x--- 1 pixelfed www-data 1383136  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg.jpg
-rwxr-x--- 1 pixelfed www-data  310518  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/NWFk2btcLjw3:
insgesamt 904
-rwxr-x--- 1 pixelfed www-data 736558  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ.jpg
-rwxr-x--- 1 pixelfed www-data 185085  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ_thumb.jpg
lapineige commented 9 months ago

Can you chmod 750 /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg, reload php8.2-fpm service and tell me if the broken picture works ?

Zeitverschreib commented 9 months ago

No luck.

root@zwoelfdreifuenfundvierzig:/home/admin# chmod 750 /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
root@zwoelfdreifuenfundvierzig:/home/admin# ls -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/*
/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh:
insgesamt 120
-rwxr-x--- 1 pixelfed www-data 119069 11. Sep 19:00 bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/BpwmGqqQ63kr:
insgesamt 520
-rwxr-x--- 1 pixelfed www-data 442529  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp.jpg
-rwxr-x--- 1 pixelfed www-data  82358  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/dIKte5MiNgnr:
insgesamt 1316
-rwxr-x--- 1 pixelfed www-data 1095621  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj.jpg
-rwxr-x--- 1 pixelfed www-data  249582  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/DQ6A7QpuV5Oh:
insgesamt 840
-rwxr-x--- 1 pixelfed www-data 615820  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO.jpg
-rwxr-x--- 1 pixelfed www-data 241578  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ibCLTLeuezBA:
insgesamt 1416
-rwxr-x--- 1 pixelfed www-data 1074732  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks.jpg
-rwxr-x--- 1 pixelfed www-data  368745  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ihi6kukMhtqQ:
insgesamt 0

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/mIB5E9tiTsus:
insgesamt 1656
-rwxr-x--- 1 pixelfed www-data 1383136  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg.jpg
-rwxr-x--- 1 pixelfed www-data  310518  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/NWFk2btcLjw3:
insgesamt 904
-rwxr-x--- 1 pixelfed www-data 736558  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ.jpg
-rwxr-x--- 1 pixelfed www-data 185085  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ_thumb.jpg

The image still shows "No Preview Available".

lapineige commented 9 months ago

I forgot to look at the directory…

namei /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg ?

You may try the same chmod command but with the directory instead.

Zeitverschreib commented 9 months ago

You mean

chmod 750 /var/www/pixelfed/public/storage/m/_v2/428947132208586753/

?

After chmod and restart: 

root@zwoelfdreifuenfundvierzig:/home/admin# namei /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
f: /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
 d /
 d var
 d www
 d pixelfed
 d public
 l storage -> /var/www/pixelfed/storage/app/public
   d /
   d var
   d www
   d pixelfed
   d storage
   d app
   d public
 d m
 d _v2
 d 428947132208586753
 d ea59ea880-d2aad0
 d AbCr2yiJSBWh
 - bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
lapineige commented 9 months ago

It was namei -l, sorry…

Zeitverschreib commented 9 months ago 
root@zwoelfdreifuenfundvierzig:/home/admin# namei -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
f: /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
drwxr-xr-x root     root     /
drwxr-xr-x root     root     var
drwxr-xr-x root     root     www
drwxr-x--- pixelfed www-data pixelfed
drwxrwx--- pixelfed www-data public
lrwxrwxrwx pixelfed www-data storage -> /var/www/pixelfed/storage/app/public
drwxr-xr-x root     root       /
drwxr-xr-x root     root       var
drwxr-xr-x root     root       www
drwxr-x--- pixelfed www-data   pixelfed
drwxrwx--- pixelfed www-data   storage
drwxrwx--- pixelfed www-data   app
drwxrwx--- pixelfed www-data   public
drwxrwx--- pixelfed www-data m
drwxrwx--- pixelfed www-data _v2
drwxr-x--- pixelfed www-data 428947132208586753
drwxr-x--- pixelfed www-data ea59ea880-d2aad0
drwxr-x--- pixelfed pixelfed AbCr2yiJSBWh
-rwxr-x--- pixelfed www-data bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
lapineige commented 9 months ago

That's it ! drwxr-x--- pixelfed pixelfed AbCr2yiJSBWh

→ chown pixelfed:www-data /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh

Zeitverschreib commented 9 months ago

Yes, that solved the problem. The imported post is ok now.

lapineige commented 9 months ago

Ok so there seems to be another process (than php ?) that handle the file creation… it should have been fixed by the import fix.

Thanks for sharing this, it helps !

So that's the workaround for now…