Failed to hash file xxx

gaetschwartz commented 1 month ago

The bug

It seems like some image files crashing the HashService component of the mobile app.

The OS that Immich Server is running on

Linux gaetans-home 6.10.10-200.fc40.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 18:26:09 UTC 2024 x86_64 GNU/Linux

Version of Immich Server

1.116.0

Version of Immich Mobile App

1.116.0

Platform with the issue

[ ] Server
[ ] Web
[X] Mobile

Your docker-compose.yml content

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    extends:
      file: hwaccel.transcoding.yml
      service: quicksync # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always
    healthcheck:
      disable: false

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always
    healthcheck:
      disable: false

  redis:
    container_name: immich_redis
    image: docker.io/redis:6.2-alpine@sha256:2d1463258f2764328496376f5d965f20c6a67f66ea2b06dc42af351f75248792
    healthcheck:
      test: redis-cli ping || exit 1
    restart: always

  database:
    container_name: immich_postgres
    image: docker.io/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      # Do not edit the next line. If you want to change the database storage location on your system, edit the value of DB_DATA_LOCATION in the .env file
      - ${DB_DATA_LOCATION}:/var/lib/postgresql/data
    healthcheck:
      test: pg_isready --dbname='${DB_DATABASE_NAME}' --username='${DB_USERNAME}' || exit 1; Chksum="$$(psql --dbname='${DB_DATABASE_NAME}' --username='${DB_USERNAME}' --tuples-only --no-align --command='SELECT COALESCE(SUM(checksum_failures), 0) FROM pg_stat_database')"; echo "checksum failure count is $$Chksum"; [ "$$Chksum" = '0' ] || exit 1
      interval: 5m
      start_interval: 30s
      start_period: 5m
    command: ["postgres", "-c", "shared_preload_libraries=vectors.so", "-c", 'search_path="$$user", public, vectors', "-c", "logging_collector=on", "-c", "max_wal_size=2GB", "-c", "shared_buffers=512MB", "-c", "wal_compression=on"]
    restart: always

volumes:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library
# The location where your database files are stored
DB_DATA_LOCATION=./postgres

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
# TZ=Etc/UTC

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

Reproduction steps

Have pictures in your photos on iOS
Start sync either manually or automatically
Check logs

Relevant log output

Immich App logs

```shell 2024-09-27 13:06:51.310343 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6566BFE5-A22F-469A-876A-212E86632C22_L0_001_1727109796.117346_o_IMG_7572.HEIC, skipping | 2024-09-27 13:06:51.310341 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DFD397A8-9F77-4F8B-A3F7-944B2724054F_L0_001_1727109796.109524_o_IMG_7573.HEIC, skipping | 2024-09-27 13:06:51.310340 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/36E13C3E-209E-422B-B6A2-B916D2F79C4A_L0_001_1727109796.081740_o_IMG_7574.HEIC, skipping | 2024-09-27 13:06:51.310339 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/705818BC-C032-498F-B6FB-BE202ADB6E22_L0_001_1727109796.104271_o_IMG_7575.HEIC, skipping | 2024-09-27 13:06:51.310338 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/109D7A83-817C-49FF-AFE4-C838FF59BCF7_L0_001_1727109796.069043_o_IMG_7576.HEIC, skipping | 2024-09-27 13:06:51.310337 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/3CAD15C5-FA32-43B3-A56B-DCF96AAE69C6_L0_001_1727109796.073709_o_IMG_7577.HEIC, skipping | 2024-09-27 13:06:51.310335 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/B055A1E7-693B-4696-96A8-7EA75FA0C83A_L0_001_1727109796.099173_o_IMG_7578.HEIC, skipping | 2024-09-27 13:06:51.310334 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8879B05E-4DDE-4F4B-852C-2CCC69F879DD_L0_001_1727109796.089509_o_IMG_7579.HEIC, skipping | 2024-09-27 13:06:51.310333 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/50CA5F42-9BA2-40A2-AAEC-F5D150903896_L0_001_1727109796.072236_o_IMG_7580.HEIC, skipping | 2024-09-27 13:06:51.310332 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C7C483D2-0FBD-4F57-93A7-828D3C70F30E_L0_001_1727109796.062806_o_IMG_7581.HEIC, skipping | 2024-09-27 13:06:51.310331 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5F7F0B1E-14E7-4768-8ADF-30D55C6FBB30_L0_001_1727109796.095542_o_IMG_7582.HEIC, skipping | 2024-09-27 13:06:51.310330 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/66E92E1E-BEE7-4B61-8442-480A41DE9594_L0_001_1727109796.101559_o_IMG_7583.HEIC, skipping | 2024-09-27 13:06:51.310329 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/0C663196-2BF3-4678-8EAE-87AD62986FBE_L0_001_1727109796.087488_o_IMG_7584.HEIC, skipping | 2024-09-27 13:06:51.310328 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/708D94F3-8B78-4F39-825F-5B816AE58C72_L0_001_1727109796.076904_o_IMG_7585.HEIC, skipping | 2024-09-27 13:06:51.310327 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/368E5866-FECB-4BE2-BE71-1A9F9B260D35_L0_001_1727109796.061043_o_IMG_7586.HEIC, skipping | 2024-09-27 13:06:51.310326 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D69F8CF2-101B-4278-B2E1-22517D01C4C7_L0_001_1727109796.113371_o_IMG_7587.HEIC, skipping | 2024-09-27 13:06:51.310323 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/279339FC-C57F-4EC7-B7FC-43C9B7D88D42_L0_001_1727109796.091792_o_IMG_7588.HEIC, skipping | 2024-09-27 13:06:51.310322 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/88D3A4AE-B833-4BAD-A10C-EB19DC602054_L0_001_1727109796.064303_o_IMG_7589.HEIC, skipping | 2024-09-27 13:06:51.310321 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5AE720CA-7097-48E2-9337-925BAF989914_L0_001_1727109796.083036_o_IMG_7590.HEIC, skipping | 2024-09-27 13:06:51.310320 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/BE644D4C-F395-4A29-9AE4-2830E84C0E34_L0_001_1727109796.078162_o_IMG_7591.HEIC, skipping | 2024-09-27 13:06:51.310319 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D13AC125-226C-458F-B390-196F9E3BEEF0_L0_001_1727109796.115301_o_IMG_7592.HEIC, skipping | 2024-09-27 13:06:51.310318 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/828E505A-054D-4F73-A78D-268896188EF5_L0_001_1727109796.116756_o_IMG_7593.HEIC, skipping | 2024-09-27 13:06:51.310317 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8B0B692D-7F5A-4BAD-B08A-B994488731EC_L0_001_1727109796.079247_o_IMG_7594.HEIC, skipping | 2024-09-27 13:06:51.310316 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/03AD8E14-0DD2-453B-AFF4-A99A40B0C895_L0_001_1727109796.090637_o_IMG_7595.HEIC, skipping | 2024-09-27 13:06:51.310315 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/1BD3B0FE-4824-4A62-9AF3-E3373EA18BF9_L0_001_1727109796.502689_o_IMG_7596.HEIC, skipping | 2024-09-27 13:06:51.310313 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/39F43356-6AB6-4A83-BB2D-6C94E3E4E738_L0_001_1727109796.490096_o_IMG_7597.HEIC, skipping | 2024-09-27 13:06:51.310301 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/7A9E7E06-051C-4509-BCEC-856B16203A41_L0_001_1727109796.458586_o_IMG_7598.HEIC, skipping | 2024-09-27 13:06:51.310299 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DD19279C-F2E2-4F1C-8150-A6F0DC485FD4_L0_001_1727109796.486588_o_IMG_7599.HEIC, skipping | 2024-09-27 13:06:51.310296 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/EA5B26C7-6DA5-4E1B-B012-C7C0DAC754D0_L0_001_1727109796.494530_o_IMG_7600.HEIC, skipping | 2024-09-27 13:06:51.310293 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/14E99223-6F82-4CF1-8E5F-6625A347F065_L0_001_1727109796.480662_o_IMG_7601.HEIC, skipping | 2024-09-27 13:06:51.310287 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/BD959338-D494-4FBF-8844-1982E6951FB1_L0_001_1727109796.493362_o_IMG_7602.PNG, skipping | 2024-09-27 13:06:51.310285 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C9D6DC50-A052-4480-93B1-B26CFFFA7E86_L0_001_1727109796.470475_o_IMG_7603.HEIC, skipping | 2024-09-27 13:06:51.310282 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/EC546CCE-4A8C-4DD3-82E9-C25BE2BFF37C_L0_001_1727109796.459164_o_IMG_7604.HEIC, skipping | 2024-09-27 13:06:51.310279 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6E68D9FC-89F9-4BBF-8176-7924E9FFD815_L0_001_1727109796.500422_o_IMG_7605.HEIC, skipping | 2024-09-27 13:06:51.310277 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/CCD5365A-63BD-45AD-8633-74D820C1EA32_L0_001_1727109796.457448_o_IMG_7606.HEIC, skipping | 2024-09-27 13:06:51.310274 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/7621D969-FBE7-4BB8-8BD3-13D7FFFC37AF_L0_001_1727109796.483068_o_IMG_7607.HEIC, skipping | 2024-09-27 13:06:51.310271 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/CA66DB7C-A17C-475C-AD1E-BA450D0E787C_L0_001_1727109796.463177_o_IMG_7608.HEIC, skipping | 2024-09-27 13:06:51.310256 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/FB233196-84AE-49B8-9E72-9C3A6649D41A_L0_001_1727109796.450395_o_IMG_7609.HEIC, skipping | 2024-09-27 13:06:51.310253 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/2D9ACE33-7545-405B-99B0-6D79DAE8B9F1_L0_001_1727109796.486016_o_IMG_7610.HEIC, skipping | 2024-09-27 13:06:51.310251 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/A78C2058-3612-4AD6-8E57-DCD72B4FC660_L0_001_1727109796.474090_o_IMG_7611.HEIC, skipping | 2024-09-27 13:06:51.310248 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6628B488-C80C-4373-869E-441EF5833801_L0_001_1727109796.444549_o_IMG_7612.HEIC, skipping | 2024-09-27 13:06:51.310245 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C15310C2-1100-49BB-BB22-B8FA73DCCC3E_L0_001_1727332275.380634_o_IMG_7613.HEIC, skipping | 2024-09-27 13:06:51.310243 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/30E96907-27CA-4628-9E79-345DA6EF5700_L0_001_1727109796.458043_o_IMG_7614.HEIC, skipping | 2024-09-27 13:06:51.310238 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/67E9293E-398C-4398-89E9-B1C3FF1ABBDA_L0_001_1727109796.501016_o_IMG_7615.HEIC, skipping | 2024-09-27 13:06:51.310235 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/61D20E20-29B1-4929-9AE7-618712797420_L0_001_1727109796.502146_o_IMG_7616.HEIC, skipping | 2024-09-27 13:06:51.310232 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.video/E745F96A-2D58-4066-9C14-E55BDE5FC3C9_L0_001_1727109796.466586_o_IMG_7617.MOV, skipping | 2024-09-27 13:06:51.310230 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.video/D5BA2E04-7C65-4D16-8415-4A5D96FDF54A_L0_001_1727109796.475447_o_IMG_7618.MOV, skipping | 2024-09-27 13:06:51.310227 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/CB7394BF-8EE9-4873-94C0-705BB66B46C0_L0_001_1727109796.454526_o_IMG_7619.HEIC, skipping | 2024-09-27 13:06:51.310224 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/9D6F6579-9B4C-49FE-A310-21276DB8BF10_L0_001_1727109796.468793_o_IMG_7620.HEIC, skipping | 2024-09-27 13:06:51.310222 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5B75844E-17DD-42B7-BEBC-51B04308991D_L0_001_1727109796.482441_o_IMG_7621.HEIC, skipping | 2024-09-27 13:06:51.310219 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DBF21CC1-CDA8-413A-AC4E-B9BF0773BA29_L0_001_1727109796.487720_o_IMG_7622.HEIC, skipping | 2024-09-27 13:06:51.310216 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/98CDEFB6-AF79-46A5-BA9D-4C5B12F633F3_L0_001_1727109796.467126_o_IMG_7623.HEIC, skipping | 2024-09-27 13:06:51.310214 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/21D0D122-04DC-460F-ACA8-D80CB193C5E5_L0_001_1726941404.685411_o_IMG_7624.PNG, skipping | 2024-09-27 13:06:51.310211 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/426FC6BD-D3E3-4A6E-95DC-D4139B17D7FA_L0_001_1727109796.495720_o_IMG_7625.HEIC, skipping | 2024-09-27 13:06:51.310209 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8AFB3B97-9E4F-46FB-8935-BAA36DB8FD02_L0_001_1727109796.450998_o_IMG_7626.HEIC, skipping | 2024-09-27 13:06:51.310206 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/F9352738-D05A-4038-B064-985A5AA182CA_L0_001_1727332275.377222_o_IMG_7627.HEIC, skipping | 2024-09-27 13:06:51.310200 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/DCCC7B47-366C-4914-85AE-78E0EA8B768F_L0_001_1727109796.496303_o_IMG_7628.HEIC, skipping | 2024-09-27 13:06:51.310198 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/46B791E7-43B3-4EBE-A797-7E26CCD8294A_L0_001_1727109796.481847_o_IMG_7629.HEIC, skipping | 2024-09-27 13:06:51.310195 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/1483176D-908B-4D8D-A59E-ADC1741C2C2D_L0_001_1727109796.478398_o_IMG_7630.HEIC, skipping | 2024-09-27 13:06:51.310192 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/E95FDA27-A625-45ED-B9DF-0FBEF7CE5BFE_L0_001_1727109796.460333_o_IMG_7631.HEIC, skipping | 2024-09-27 13:06:51.310190 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/A5FFA9F4-EF85-4F4D-AFB0-C8B7EF9A564F_L0_001_1727109796.474722_o_IMG_7632.HEIC, skipping | 2024-09-27 13:06:51.310187 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/0DD828F9-9608-4C6E-9552-42594A641E1E_L0_001_1727109796.466025_o_IMG_7633.HEIC, skipping | 2024-09-27 13:06:51.310184 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D613074C-724E-4B0A-93B1-31013757C225_L0_001_1727109796.462618_o_IMG_7634.HEIC, skipping | 2024-09-27 13:06:51.310182 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C23A45B1-1AC4-40F1-A384-1586374382E8_L0_001_1727109796.443280_o_IMG_7635.HEIC, skipping | 2024-09-27 13:06:51.310179 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/1C0AEFE4-6760-400C-BDD8-27F06E42FE68_L0_001_1727109796.483652_o_IMG_7636.HEIC, skipping | 2024-09-27 13:06:51.310177 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/31E1CC61-3B39-41F0-9127-84D5AD9C5272_L0_001_1727109796.455086_o_IMG_7637.HEIC, skipping | 2024-09-27 13:06:51.310174 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/D4ACE6C5-55BC-4A3A-8BCF-A26FEA4F73EB_L0_001_1727109796.489471_o_IMG_7638.HEIC, skipping | 2024-09-27 13:06:51.310171 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/6EC837B8-5618-49D7-9D93-2272E960E2AB_L0_001_1727109796.484278_o_IMG_7639.HEIC, skipping | 2024-09-27 13:06:51.310168 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/FCA91416-8F1D-4359-894E-7D0C5435D574_L0_001_1727109796.446301_o_IMG_7640.HEIC, skipping | 2024-09-27 13:06:51.310162 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/F5AC8F6D-0C15-47DF-A39C-3EA5C184EEAA_L0_001_1727109796.472817_o_IMG_7641.HEIC, skipping | 2024-09-27 13:06:51.310155 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/917463BA-A7A3-485C-97BC-622700582DA3_L0_001_1727109796.471621_o_IMG_7642.HEIC, skipping | 2024-09-27 13:06:51.310152 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/18459578-ABBF-44CA-A726-508B94D73A51_L0_001_1727109796.472173_o_IMG_7643.HEIC, skipping | 2024-09-27 13:06:51.310149 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/E1D526C7-1679-42A3-ABAD-FE5488FF5080_L0_001_1727109796.443935_o_IMG_7644.HEIC, skipping | 2024-09-27 13:06:51.310146 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/E5B9F3DF-5D7D-4D6E-89B7-3E37216D918E_L0_001_1727109796.445134_o_IMG_7645.HEIC, skipping | 2024-09-27 13:06:51.310142 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/8B257205-1ED7-4BC2-9BD6-D894B24AB4CC_L0_001_1727109796.496872_o_FullSizeRender.jpg, skipping | 2024-09-27 13:06:51.310139 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/C43EE801-11C0-4096-A93E-B022CFA20AE1_L0_001_1727109796.471041_o_FullSizeRender.jpg, skipping | 2024-09-27 13:06:51.310134 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/5D259E5F-11CB-4853-B909-4550F93614FF_L0_001_1727109796.477205_o_FullSizeRender.jpg, skipping | 2024-09-27 13:06:51.310096 | WARNING | HashService | Failed to hash file /private/var/mobile/Containers/Data/Application/57135014-AADD-4516-A9FA-719F61C74702/tmp/.image/31DF2B1E-440B-48B5-982B-F7BEAE3C1297_L0_001_1727109796.498599_o_FullSizeRender.jpg, skipping | ```

Additional information

Note: I am unable to reproduce the issue multiple times on the same app, it seems like it fails once and after it just silently fails the backup, staying stuck loading. That said, it can be reproduced by deleting and reinstalling the app.

alextran1502 commented 1 month ago

Those are the files that the app doesn't have access or cannot read. It is usually the symptoms of assets from Shared Album that have been moved by other users or corrupted file

gaetschwartz commented 1 month ago

Right, when disabling related iCloud albums this works. We should find a way to not try to hash these files in the first place probably ?

alextran1502 commented 1 month ago

I think those files are no longer available but the database on iOS still have those records somehow

UmarFarooq-Ch commented 1 month ago

I am also facing the same problem! There are around 2-3K photos that the Immich app is unable to back up, resulting in a decrease in the total number of photos. For example, I deleted the app, reinstalled it, and logged back in. The first column shows the initial stats, while the second column represents the current state:

Total: 30,971 -> 27,818
Backup: 27,772 -> 27,810
Remainder: 3,199 -> 9

Now, whenever I open the app, it always shows me the current state, and it doesn't seem to attempt a re-backup.

I can see these errors in my app logs from the first time it skipped the photos:

Message Error getting file to hash for asset 9BDDD9F3-F909-45D8-85E9-EA3753D1F19F/L0/001, name: BF6CE792-BBA8-4432-BB24-2FA374D460B4.HEIC, created on: 2023-04-23 11:09:44.000, skipping

Details

PlatformException(CloudPhotoLibraryErrorDomain (1005), The operation couldn’t be completed. (CloudPhotoLibraryErrorDomain error 1005.), No failure reason provided, null)

From HashService

Stack Trace

#0      StandardMethodCodec.decodeEnvelope (package:flutter/src/services/message_codecs.dart:648)
#1      MethodChannel._invokeMethod (package:flutter/src/services/platform_channel.dart:334)
<asynchronous suspension>
#2      AssetEntity._getFile (package:photo_manager/src/types/entity.dart:750)
<asynchronous suspension>
#3      HashService._hashAssets (package:immich_mobile/services/hash.service.dart:77)
<asynchronous suspension>
#4      SyncService._addAlbumFromDevice (package:immich_mobile/services/sync.service.dart:704)
<asynchronous suspension>
#5      diffSortedLists (package:immich_mobile/utils/diff.dart:30)
<asynchronous suspension>
#6      SyncService._syncLocalAlbumAssetsToDb (package:immich_mobile/services/sync.service.dart:516)
<asynchronous suspension>
#7      AsyncMutex.run.<anonymous closure> (package:immich_mobile/utils/async_mutex.dart:15)
<asynchronous suspension>

https://github.com/user-attachments/assets/87ca6f77-2b25-4317-8b61-c16e0f75f63c

immich-app / immich