Exclamation mark on ios app

[darrepac]

Hello

What those exclamations marks mean? (knowing that all my photo have been imported)

I have the logs available but don't know if it is so secure to share it here

[fuji246]

Looks like some problem on fetching the preview, you can share the log via email to support@lomorage.com

[darrepac]

 Looks like there is a lot of file missing in the file system but exists in db, so inconsistent between the two.

check lomod.log and some logs below:

time="2022-07-11T03:28:31Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_42909.jpg is not found in file system, remove from DB"
time="2022-07-11T03:28:32Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_26993.jpg is not found in file system, remove from DB"
time="2022-07-11T03:28:32Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_26951.jpg is not found in file system, remove from DB"
time="2022-07-11T03:28:32Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_26960.jpg is not found in file system, remove from DB"
time="2022-07-11T03:28:32Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_26985.jpg is not found in file system, remove from DB"
time="2022-07-11T03:28:33Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_26968.jpg is not found in file system, remove from DB"
time="2022-07-11T03:28:33Z" level=warning msg="User 's /media/primary/pascal/Photos/master/2007/06/17/20070617_26968.jpg is not found in file system, remove from DB"

Maybe you tried to remove the assets, restart over but not delete the database file? Those records should be deleted from database automatically, and everything should back to normal, you can try restart lomod and restart iOS APP (or may need reinstall iOS APP), let me know if that works.

Well I did not touch any photos. May-be it come from the fact that I did a massive import with -n option ?? so it is normal to not find the file at this place??

[fuji246]

@dwebfan could you confirm?

[fuji246]

@darrepac , once those records are cleaned, are you still having the problem?

[darrepac]

Well, I have no more such exclamation mark cause I have no more photos... Only remains the ones that was from my camera roll. It has deleted from db all the 40k that I have imported previously (with --no-move) during days :(

[fuji246]

find the problem on backend, will fix it this week.

[darrepac]

ok keep me updated

[fuji246]

@darrepac , could you update lomod and try import again with --no-move?

[darrepac]

On going (will take several days with all photos and videos...)

[darrepac]

So I started the import again. But as I did it previously, all the thumbnails and video previews are already present, but lomoc import is recreating it, it seems. There is no option or check if the preview file is already there?

[fuji246]

Did you start from scratch? Did you remove those imported before? Assuming you just reimport while keeping previously imported there, it should be able to deduplicate already imported ones, and only import those that are missing. If assets are removed, the thumbnails are supposed to be removed as well, that said, there is currently no option to check if preview files are already present, those should be removed when assets are removed, if it's there, there should be a bug somewhere. Maybe @Dweb Fan @.***> can comment.

On Thu, Jul 21, 2022 at 9:39 AM darrepac @.***> wrote:

So I started the import again. But as I did it previously, all the thumbnails and video previews are already present, but lomoc import is recreating it, it seems. There is no option or check if the preview file is already present?

— Reply to this email directly, view it on GitHub https://github.com/lomorage/homepage/issues/22#issuecomment-1191708150, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAIA466BE7H3XFL54TFJHILVVF4KXANCNFSM53GPUYBQ . You are receiving this because you commented.Message ID: @.***>

[darrepac]

I have the feeling that I have a mix of both: If I do find . -name *.* | wc -l in preview folder, it gives 5500 On one side, 5500 is much less than my 40k assets that I imported, lost, and I am currently importing again On the other, it is much more that my basis assets before importation... and I do not see those 5500 files in lomorage user interface...but in container logs I see time="2022-07-21T21:24:20Z" level=info msg="IN PROGRESS: scanned 32 directories, and imported 4965 media files" so not too far from 5500. Well let see at the end of the import....

[darrepac]

Is there an easy way to see the progress status of the scan? On the container log, I have:

asset(user_id, hash, year, month, day, ext_id, device_id, latitude, longitude, size, status, create_time, upload_time)
    values(1, 'c4225e8516afadd'/*+25 bytes*/, 2003, 1, 15, 1, 19, 0.0, 0.0, 2073017, 1, '2003-01-15 16:4'/*+10 bytes*/, '2022-07-22 07:4'/*+19 bytes*/)
time="2022-07-22T07:44:29Z" level=info msg="created asset 20030115_57476.jpg: c4225e8516afaddcbd402e05ae21bb7d707df1f9 @ 2003-1-15 from /PHOTOS/Photos_canon/2002/2002-01-15 Croix de carle/167-6740_IMG.JPG"
DB [44:30]: insert into asset_album (asset_id, album_id, orig_filename, create_time) values (57476,95,'167-6740_img.jpg', '2022-07-22 07:4'/*+20 bytes*/)
time="2022-07-22T07:44:31Z" level=info msg="start create asset: /PHOTOS/Photos_canon/2020/IMG_9925.jpg (jpg) for user: 1 from 19"

which doesn't indicate me the progress. There should be something likeimported xxxx so far over xxxx files

I also did find . -name *.* | wc -l in preview folder but it doesn't seem so accurate: number is no moving after 1 hour...

[darrepac]

Importing still running… I am a bit afraid because the mobile app is not showing any added assets… but maybe it is due to my server running at 100% CPU and not answering on time requests (?)

[fuji246]

Should caused by CPU. For testing purpose, you can just try import a subfolder.

[fuji246]

@darrepac , how is the import going?

[darrepac]

Still running after 12 days… that’s why I asked a progress status somewhere ;) In any case, I am back home for 1 day and leaving for 2 weeks. But next time, I will follow your recommendation and import only one folder…

[darrepac]

Still running after 12 days… that’s why I asked a progress status somewhere ;)

Have seen this in the log: level=info msg="IN PROGRESS: scanned 635 directories, and imported 1370 media files" Is this a progress status? Can't you:

• update the status after each asset imported
• at least say the total number of directories it will scan in order to know where we are (unless you don't know at this stage?)

[fuji246]

Currently lomoc import is via API call to the backend, we should be able to add some logs in lomod.log to show where we are , currently seems it only print warn/err logs.

[fuji246]

I'm surprised the import is still ongoing, sorry about that. Are you using more powerful PC now?

[darrepac]

I'm surprised the import is still ongoing, sorry about that. Are you using more powerful PC now?

Well no... didn't have the time to setup when I was home. I made a new import to get the new photos I made in the meantime... so now, I don't know if the first import is still going or I have only the second one. But on the best scenario, it would mean it took 1 month to import my database...

Nevertheless, yes it is slow and yes the server CPU, hdd has a direct impact. Yet by trying different solution with same server (Librephoto, Photoprism, Photoview, Home Gallery etc), I can say that Lomorage is on the slow side... may-be something to improve. At a first guess, video is one clear bottleneck particularly as lomorage is transcoding on different resolution for 1 video.

[darrepac]

No way to see the progress status?

Le 27 juil. 2022 à 16:53, Jiantao Fu @.***> a écrit :

 Should caused by CPU. For testing purpose, you can just try import a subfolder.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.

[dwebfan]

No way to see the progress status?

Will add in next release.

[fuji246]

@darrepac , could you update and try again?

[fuji246]

close it now, feel free to reopen if it still happens.

[darrepac]

@darrepac , could you update and try again?

I am really busy this end of the year. Hope to be able to help you later on