Closed zsolt-donca closed 1 year ago
Screenshot:
Hello, if you logout and log back in, does it solve the issue?
I just tried that, signed out and signed back in the mobile app. It didn't do anything.
And the weirdest thing is that I did the same setup on my wife's phone (the same model as mine, same app version, different immich user), and her photos are not duplicated, and everything seems to have the cloud with the checkmark icon in it, as it should.
Where did the assets with the cloud icon get uploaded? the asset with the cross checkmark item meaning they haven't been backup yet?
I just picked one file named PXL_20230625_134316938.jpg
, the remote path is:
/var/local/immich/store/library/d30dd4c8-53c2-4f26-81f2-f7b743ac76e0/2023/2023-06-25
The "duplicate" shows up as having the same name. I just checked the checksums of the two files, and even though they have the same size (4106854 bytes), the md5 and sha1 checksums are different. Is this intended behavior? Or it this difference behind the issue?
From your screenshot, there are two icons
From the step you outlined for reproduction, you haven't performed backing up on this device, is that correct?
I'm sorry about this confusion. The icons on the screenshot you cropped are like that because I hit the "download" button on two images with the cloud icons. I didn't do the same on the other pictures, and they look like all pairs looked like initially: one with the cloud icon, and another with the crossed out cloud icon.
Before writing these lines I tested the same thing, and the cloud-iconed photos completely disappeared from the gallery. 🫤
Can you help me with the question of whether or not you have uploaded anything photos or videos on the phone that you used to take the screenshot?
The photos on the screenshot were uploaded using the "Backup Albums" feature from the phone that I took the screenshot from. My photo album was initially empty, I selected some albums to back up, and then those duplicates practically immediately showed up (that is, each photo twice, one with cloud icon, another one with the cloud striked through).
Thank you.
For photos with the cloud-only icon, it means they exist on the server but not on the device. Can you confirm that you haven't run the upload/backup for any assets on this device?
Can you help with a screenshot of the backup page?
Also, can you help me enable the advanced debugging on the settings pagee? Then for the pair of duplicated assets, capture the screenshot of the info page of each image. It should show the file information to see if there is something different between those two files.
Can you confirm that you haven't run the upload/backup for any assets on this device?
I am sure that the issue appeared before doing anything more than selecting some albums to back up. Since then I tried fumbling around with the settings, as it wasn't clear to me that this is likely a bug that I should report. I remember having changed some Backup settings and then pressing the "Start Backup" icon.
Here are some screenshots of the Backup page:
Also, can you help me enable the advanced debugging on the settings pagee?
How do I do that?
Here are screenshots of the info pages of a pair of identical images:
And the images look like this in the gallery:
I think you were referring to these info, the local one:
{
"id": 24,
"remoteId": "N/A",
"localId": "1000002286",
"checksum": "3i0lGXxH535ZHavulFW9QcWe/YQ=",
"ownerId": 7001128083095369042,
"livePhotoVideoId": "N/A",
"fileCreatedAt": "2023-06-25 14:47:31.000",
"fileModifiedAt": "2023-06-25 14:47:34.000",
"updatedAt": "2023-06-25 14:47:34.000",
"durationInSeconds": 0,
"type": "AssetType.image",
"fileName": "PXL_20230625_114731056.jpg",
"isFavorite": false,
"isRemote: false,
"storage": "AssetState.local",
"width": 3072,
"height": 4080,
"isArchived": false
}
And the remote one:
{
"id": 399,
"remoteId": "e409707e-3c28-4e8e-b6a1-f34a8a6c5fe5",
"localId": "N/A",
"checksum": "mALNwZE1ZqEUGh8/LseVNwYaPF8=",
"ownerId": 7001128083095369042,
"livePhotoVideoId": "N/A",
"fileCreatedAt": "2023-06-25 14:47:31.000",
"fileModifiedAt": "2023-06-25 17:47:34.000",
"updatedAt": "2023-06-26 12:23:08.768",
"durationInSeconds": 0,
"type": "AssetType.image",
"fileName": "PXL_20230625_114731056.jpg",
"isFavorite": false,
"isRemote: true,
"storage": "AssetState.remote",
"width": 3072,
"height": 4080,
"isArchived": false
}
Hmm, you can see the updatedAt
property is different on the remote one. Did the file get modified once it get to UPLOAD_LOCATION
?
Yeah, I saw that too. The checksum is different also. I didn't do anything to any of the pictures. I have some tens of cases, spanning across at least three days. I don't know what could have cause these changes.
@fyfrey Can you think of any scenario in this case that could happen?
This is why I made the PR to find and delete corrupt assets.
The assets uploaded miss their EXIF Info. Google thought it would be cool to randomly strip GPS EXIF from files :-). Same size but different hash. Since we now sync/merge assets based on hash, you have duplicates..
Solution: Delete all remote assets and reupload with newest app (1.64.0) release. If that is a no-go, wait for my PR to delete only corrupt uploaded assets.
This conclusion is fine by me. I will delete the remote assets and re-upload everything. 👍
Google thought it would be cool to randomly strip GPS EXIF from files
This is the most Google thing that I heard in a while... 🫣
Thanks everyone for this great project!
Please let me know if it works (or still produces files with different hashes). Thanks!
It works. I installed the latest release (both on mobile and on the server), cleaned up the duplicate photos on web, backed up the photos once again locally, and this time there were no duplicates. Also gave the mobile app location permissions for good measure.
The bug
Most of my photos and videos appear twice in the timeline, once with the cloud icon, and once again with the "cloud-off" icon (cloud with a slanted line). If I download one of the cloudy photos, the icon will have a check mark in it, as if Immich considered the two separate.
This happens on a clean install, with the mobile app uploading the first photos to the server.
Using a Pixel 7 with stock OS.
The OS that Immich Server is running on
Arch
Version of Immich Server
1.63.2
Version of Immich Mobile App
1.63.0 build.86
Platform with the issue
Your docker-compose.yml content
Your .env content
Reproduction steps
Additional information
No response