Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] iOS app upload repeat error #4339

Open
2 of 3 tasks
presario222 opened this issue Oct 4, 2023 · 20 comments
Open
2 of 3 tasks

[BUG] iOS app upload repeat error #4339

presario222 opened this issue Oct 4, 2023 · 20 comments

Comments

@presario222
Copy link

The bug

ios app upload frequently had error "PathNotFoundException" with "can not open file" or "can not delete file".

I have setup a shared album on iphone but the immich uploading album is "Recents", the default one in iphone.
and I open the icloud function "optimize iphone storage" to save some space.

1af2db0533a6a755e437c7e9f921e96

The OS that Immich Server is running on

Unraid

Version of Immich Server

v1.81

Version of Immich Mobile App

latest

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

version: "3.8"

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: [ "start.sh", "immich" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /mnt/user/media/pictures:/mnt/user/media/pictures
    env_file:
      - .env
    depends_on:
      - redis
      - database
      - typesense
    restart: always

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.yml
    #   service: hwaccel
    command: [ "start.sh", "microservices" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /mnt/user/media/pictures:/mnt/user/media/pictures
    env_file:
      - .env
    depends_on:
      - redis
      - database
      - typesense
    restart: always

  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  immich-web:
    container_name: immich_web
    image: ghcr.io/immich-app/immich-web:${IMMICH_VERSION:-release}
    env_file:
      - .env
    restart: always

  typesense:
    container_name: immich_typesense
    image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd
    environment:
      - TYPESENSE_API_KEY=${TYPESENSE_API_KEY}
      - TYPESENSE_DATA_DIR=/data
      # remove this to get debug messages
      - GLOG_minloglevel=1
    volumes:
      - tsdata:/data
    restart: always

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
    restart: always

  database:
    container_name: immich_postgres
    image: postgres:14-alpine@sha256:28407a9961e76f2d285dc6991e8e48893503cc3836a4755bbc2d40bcc272a441
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

  immich-proxy:
    container_name: immich_proxy
    image: ghcr.io/immich-app/immich-proxy:${IMMICH_VERSION:-release}
    environment:
      # Make sure these values get passed through from the env file
      - IMMICH_SERVER_URL
      - IMMICH_WEB_URL
    ports:
      - 2283:8080
    depends_on:
      - immich-server
      - immich-web
    restart: always

volumes:
  pgdata:
  model-cache:
  tsdata:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/mnt/user/media/photos

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secrets for postgres and typesense. You should change these to random passwords
TYPESENSE_API_KEY=eiwokdnsjgfds1234jgf
DB_PASSWORD=postgres

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

Reproduction steps

1.setup the immich server follow the guide.
2.download the iphone app and start to upload
3.the app's log will show error information
...

Additional information

No response

@presario222 presario222 changed the title [BUG] <title>iOS app upload repeat error [BUG] iOS app upload repeat error Oct 4, 2023
@vongoethe
Copy link

I have the same issue

@jetblack-nz
Copy link

jetblack-nz commented Nov 14, 2023

Same issue here on version 1.85. I'm backing up a large iOS library (with iCloud enabled).

When the error appears the backup from the immich app stops, and I have to cancel and start backup again. There are no errors on the server side.

This also prevent the background backup to work consistently.

@alextran1502
Copy link
Contributor

@jetblack-nz Can you elaborate on what error are you seeing, are you accessing over DNS or local IP?

@jetblack-nz
Copy link

jetblack-nz commented Nov 14, 2023

Hi @alextran1502 thanks for answering and for the great app!

The error on my iOS app matches the screenshot of the OP. The app log shows "PathNotFoundException" with "can not open file" or "can not delete file". See below.

  • iPhone 12, iOS 17.03
  • Photos with iCloud sync enabled and 'Optimise iPhone Storage' also enabled
  • I am on the same network as the server and I access it locally using the IP address (no DNS or VPN).

The issue happens every few minutes. I don't have shared albums yet, it's a fresh server install with the first backup churning through 55k photos which mostly are on iCloud.

I'm happy to provide more info or help with testing... I self-host quite a few apps and can set up a new VM or LXC in minutes.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/09EC83EA-ECCD-412E-8D5C-3DB0F23D9831/tmp/.image/D44C463E-91C0-4187-ABC5-62A1BDE57A62_L0_001_1574712794.916106_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/09EC83EA-ECCD-412E-8D5C-3DB0F23D9831/tmp/.image/D44C463E-91C0-4187-ABC5-62A1BDE57A62_L0_001_1574712794.916106_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2)

@Uberpainer
Copy link

Uberpainer commented Nov 15, 2023

I have the same issue on ser version 1.86 and iOS app version 1.86 in iOS 17.
Did try reinstall the application and restart the containers without any luck.
I have to kill the stalled backup in the application and then start it over to backup any other pictures taken after error.

2023-11-15 19:42:54.073644,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55) #1 _File.open.<anonymous closure> (dart:io/file_impl.dart:381) <asynchronous suspension> #2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153) <asynchronous suspension> " 2023-11-15 19:42:52.592458,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/9B57F0FA-BD38-456D-8F9A-D0C410694481/tmp/.image/9D2DC033-393C-4A4D-8C14-BD0E6F3A9C09_L0_001_0.000000_o_IMG_2494.JPG' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55) #1 _File.open.<anonymous closure> (dart:io/file_impl.dart:381) <asynchronous suspension> #2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153) <asynchronous suspension> "

@alextran1502
Copy link
Contributor

@Uberpainer Are you using iCloud with Optimized Storage options enabled?

@Uberpainer
Copy link

@alextran1502 No on both mine and her iPhone are Optimized Storage options not enabled. It's set to keep originals.

@alextran1502
Copy link
Contributor

@Uberpainer just to confirm that iCloud is used, correct?

@Uberpainer
Copy link

Uberpainer commented Nov 15, 2023

@alextran1502 Yes, thats is correct. Issue only appear on my wifes iPhone and not mine.
If you need me to test anything please say, I'm here to help as much as possible eventhough my lack of programming skills ;)

@vitobotta
Copy link

Same problem here, just checked the logs on iPhone after noticing that it's getting stuck often. Any workarounds for now? (I have iCloud enabled BTW). Thanks

@alextran1502
Copy link
Contributor

@vitobotta are you on 1.90? There is a toggle to ignore iCloud photos and videos. Let me know if it works

@Uberpainer
Copy link

Uberpainer commented Dec 9, 2023

After updated version i iOS app to version 1.90 and running server version 1.90.2 then does errors still occour. And thats even after I have set Immich app on my wife phone to ignore iCloud Photos.
Immich_log_2023-12-09T204935.138182.csv
Immich_log_2023-12-10T151028.850868.csv

@vitobotta
Copy link

@vitobotta are you on 1.90? There is a toggle to ignore iCloud photos and videos. Let me know if it works

Hi Alex, yep latest versions both server and mobile app. I tried ignoring iCloud photos but the upload just stopped working altogether. Then I reinstalled the app and left it turned on to try again with it enabled and now it's been uploading happily for a while so I will wait for now to see if it finishes. It has done 5k out of 50k photos and videos and it's not getting stuck so far, so seems to be going better now :)

@talan-z
Copy link

talan-z commented Dec 11, 2023

Hi all, I have the same issue. Latest version and only uploading "recent pictures" folder and have icloud turned off..
Reinstall of the app did not help

@mtehonica
Copy link

Having the same problem on a fresh install of Immich 1.91.3, doing an initial backup of 7k photos. iCloud enabled, Optimized Storage enabled.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2)

#0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398) <asynchronous suspension> #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461) <asynchronous suspension>

@alextran1502
Copy link
Contributor

Having the same problem on a fresh install of Immich 1.91.3, doing an initial backup of 7k photos. iCloud enabled, Optimized Storage enabled.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2)

#0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398) <asynchronous suspension> #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461) <asynchronous suspension>

@mtehonica Fixed in #5827

@mtehonica
Copy link

Having the same problem on a fresh install of Immich 1.91.3, doing an initial backup of 7k photos. iCloud enabled, Optimized Storage enabled.
Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/05EAEBBA-0D9E-40A4-8CA7-F0A88EB029CC_L0_001_1700290858.416805_o_IMG_4075.PNG' (OS Error: No such file or directory, errno = 2)
#0 _File.throwIfError (dart:io/file_impl.dart:675) #1 _File._deleteSync (dart:io/file_impl.dart:329) #2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424) #3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398) <asynchronous suspension> #4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461) <asynchronous suspension>

@mtehonica Fixed in #5827

#5827 doesn't seem to have resolved this. Still seeing this on 1.91.4.

Catch all error: PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/2EDFA739-B179-43F8-B1A8-12BD4817560C_L0_001_1700290858.381235_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot delete file, path = '/private/var/mobile/Containers/Data/Application/59CAE3CB-1B56-47B5-A5F5-D10E5D2CC60F/tmp/.image/2EDFA739-B179-43F8-B1A8-12BD4817560C_L0_001_1700290858.381235_o_FullSizeRender.jpg' (OS Error: No such file or directory, errno = 2)

#0 _File.throwIfError (dart:io/file_impl.dart:675)
#1 _File._deleteSync (dart:io/file_impl.dart:329)
#2 FileSystemEntity.deleteSync (dart:io/file_system_entity.dart:424)
#3 BackupService.backupAsset (package:immich_mobile/modules/backup/services/backup.service.dart:398
#4 BackupNotifier.startBackupProcess (package:immich_mobile/modules/backup/providers/backup.provider.dart:461)

@alextran1502
Copy link
Contributor

@mtehonica is your mobile app on 1.91.4?

@Uberpainer
Copy link

Uberpainer commented Dec 20, 2023

@alextran1502 , I have updated my wife mobile app to version 1.91.4 and run server version 1.91.4. But are still seeing issue with sync failing and stops. Keeps spinning in the "cloud icon" in the app, at give this error in the log:

created_at,level,context,message,stacktrace
2023-12-20 16:11:04.954693,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55)
#1 _File.open. (dart:io/file_impl.dart:381)

#2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153)

"
2023-12-20 16:11:04.954463,LogLevel.INFO,"AssetNotifier","Load partner assets: 5069ms",""
2023-12-20 16:11:03.344731,LogLevel.INFO,"AssetNotifier","Load assets: 3445ms",""
2023-12-20 16:11:03.344658,LogLevel.SEVERE,"ImmichErrorLogger","Catch all error: PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2) - PathNotFoundException: Cannot open file, path = '/private/var/mobile/Containers/Data/Application/F7F2D158-7CDB-4F64-BAC1-6A05F6B9A9C1/tmp/.image/4D5C31AA-EC3A-4626-A76A-A71D2C81F823_L0_001_1702855632.121231_o_IMG_2051.HEIC' (OS Error: No such file or directory, errno = 2)","#0 _checkForErrorResponse (dart:io/common.dart:55)
#1 _File.open. (dart:io/file_impl.dart:381)

#2 _FileStream._start.onOpenFile (dart:io/file_impl.dart:153)

Immich_log_2023-12-20T161140.487950.csv

@Uberpainer
Copy link

Has anyone found a workaround or solution on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

9 participants