search

dokkaner / teemii

A versatile, self-hosted manga reader and manager with extensible agent-based metadata retrieval
https://www.teemii.io
MIT License
289 stars 17 forks source link

CopyFile Error when Storage outside of Docker Volume is used #43

Open Pixwarron opened 8 months ago

Pixwarron commented 8 months ago

Description

I wish to save the downloaded content to my NAS, therefore i defined the Manga storage to be on a NFS Network share that has no ACLs set at all. I first mapped the whole data folder to be on my NAS, this throws the same error, then i mapped only the storage because i thought it might be a problem with the latency introduced by hosting the SQL Database on a NAS.

Version

0.7.8

Steps to Reproduce

  1. Map the storage to NAS
  2. Start both backend and frontend using Docker Compose
  3. Add content

Screenshots

No response

Logs

2024-01-07T13:22:22: PM2 log: Launching in no daemon mode
2024-01-07T13:22:22: PM2 log: App [server:0] starting in -fork mode-
2024-01-07T13:22:22: PM2 log: App [server:0] online
[2024-01-07 13:22:23.709 +0000] WARN: Setup is not completed. Skipping backup.
OpenAI API key is not set!
Database is not ready
[2024-01-07 13:22:23.715 +0000] INFO: ✓ Config Initialized. Setup completed: false
[2024-01-07 13:22:23.719 +0000] INFO: ✓ Express Initialized
[2024-01-07 13:22:23.719 +0000] INFO: SocketIOLoader: initializing
[2024-01-07 13:22:23.731 +0000] WARN: Schema mangaSchema validation failed for anilist
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.775 +0000] WARN: Schema mangaSchema validation failed for bato
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.776 +0000] WARN: Schema chapterSchema validation failed for bato
    errors: [
      "Key titles is missing from agent schema",
      "Key vote is missing from agent schema",
      "Key groupScan is missing from agent schema",
      "Key externalIds is missing from agent schema",
      "Key externalLinks is missing from agent schema"
    ]
[2024-01-07 13:22:23.777 +0000] WARN: Schema mangaSchema validation failed for comickfun
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.777 +0000] WARN: Schema chapterSchema validation failed for comickfun
    errors: [
      "Key vote is missing from agent schema",
      "Key externalIds is missing from agent schema",
      "Key externalLinks is missing from agent schema"
    ]
[2024-01-07 13:22:23.779 +0000] WARN: Schema mangaSchema validation failed for goodreads
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.780 +0000] WARN: Schema mangaSchema validation failed for kitsu
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.782 +0000] WARN: Schema mangaSchema validation failed for mal
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.783 +0000] WARN: Schema mangaSchema validation failed for mangadex
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.783 +0000] WARN: Schema chapterSchema validation failed for mangadex
    errors: [
      "Key externalIds is missing from agent schema",
      "Key externalLinks is missing from agent schema"
    ]
[2024-01-07 13:22:23.785 +0000] WARN: Schema lookupSchema validation failed for mangakakalot
    errors: [
      "Key desc is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.785 +0000] WARN: Schema mangaSchema validation failed for mangakakalot
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key score is missing from agent schema",
      "Key startYear is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.785 +0000] WARN: Schema chapterSchema validation failed for mangakakalot
    errors: [
      "Key titles is missing from agent schema",
      "Key volume is missing from agent schema",
      "Key pages is missing from agent schema",
      "Key groupScan is missing from agent schema",
      "Key externalIds is missing from agent schema",
      "Key externalLinks is missing from agent schema"
    ]
[2024-01-07 13:22:23.786 +0000] WARN: Schema mangaSchema validation failed for mangapill
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key score is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.786 +0000] WARN: Schema chapterSchema validation failed for mangapill
    errors: [
      "Key titles is missing from agent schema",
      "Key vote is missing from agent schema",
      "Key groupScan is missing from agent schema",
      "Key externalIds is missing from agent schema",
      "Key externalLinks is missing from agent schema"
    ]
[2024-01-07 13:22:23.787 +0000] WARN: Schema mangaSchema validation failed for mangaupdates
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.788 +0000] WARN: Schema mangaSchema validation failed for nautiljon
    errors: [
      "Key description is missing from agent schema",
      "Key coverImage is missing from agent schema",
      "Key url is missing from agent schema"
    ]
[2024-01-07 13:22:23.789 +0000] INFO: Loaded 12 agents
[2024-01-07 13:22:23.789 +0000] WARN: No database path provided
[2024-01-07 13:22:23.789 +0000] WARN: if it's the first launch, consider it as normal
[2024-01-07 13:22:23.790 +0000] WARN: Mangadex Login failed: No username or password provided
[2024-01-07 13:22:23.790 +0000] WARN: Mangadex Login failed: No username or password provided
[2024-01-07 13:22:23.790 +0000] INFO: -----------------------------------
[2024-01-07 13:22:23.790 +0000] INFO: teemii-backend v0.7.8 (c) Dokkaner
[2024-01-07 13:22:23.790 +0000] INFO: Environment: undefined
[2024-01-07 13:22:23.791 +0000] INFO: server started successfully
[2024-01-07 13:22:23.791 +0000] INFO: -----------------------------------
[2024-01-07 13:22:23.792 +0000] INFO: Express running, now listening on port 3000
[2024-01-07 13:22:23.792 +0000] INFO: Socket.io server listening on port 1555
[2024-01-07 13:22:26.200 +0000] INFO: Index successfully processed
[2024-01-07 13:22:26.201 +0000] INFO: Index count: 258746 items
[2024-01-07 13:22:26.201 +0000] INFO: Index size: 6.947023391723633 MB
[2024-01-07 13:22:28.415 +0000] INFO: Retrieving migrations
[2024-01-07 13:22:28.417 +0000] WARN: No migrations found in database
[2024-01-07 13:22:28.424 +0000] INFO: ✓ All migrations applied
[2024-01-07 13:22:28.512 +0000] INFO: ✓ sequelize Synced
[2024-01-07 13:22:28.512 +0000] INFO: ✓ Database Initialized
[2024-01-07 13:22:31.068 +0000] INFO: ✓ Storage Initialized
[2024-01-07 13:22:37.690 +0000] INFO: Retrieving migrations
[2024-01-07 13:22:37.691 +0000] INFO: Retrieved migrations successfully: 0 completed, 0 pending
[2024-01-07 13:22:37.691 +0000] INFO: ✓ All migrations applied
[2024-01-07 13:22:37.705 +0000] INFO: ✓ Database Initialized
[2024-01-07 13:22:37.717 +0000] INFO: Scheduler mangaImportScheduler started with pattern */10 * * * * *
[2024-01-07 13:22:37.718 +0000] INFO: Next run: 2024-01-07T13:22:40.000+00:00
[2024-01-07 13:22:37.720 +0000] INFO: Scheduler chapterDownloadScheduler started with pattern */60 * * * * *
[2024-01-07 13:22:37.720 +0000] INFO: Next run: 2024-01-07T13:23:00.000+00:00
[2024-01-07 13:22:37.721 +0000] INFO: Scheduler importCBXScheduler started with pattern */11 * * * * *
[2024-01-07 13:22:37.721 +0000] INFO: Next run: 2024-01-07T13:22:44.000+00:00
[2024-01-07 13:22:37.722 +0000] INFO: Scheduler maintenanceScheduler started with pattern */11 * * * *
[2024-01-07 13:22:37.723 +0000] INFO: Next run: 2024-01-07T13:33:00.000+00:00
[2024-01-07 13:22:37.724 +0000] INFO: Scheduler libraryUpdateScheduler started with pattern 0 * * * *
[2024-01-07 13:22:37.725 +0000] INFO: Next run: 2024-01-07T14:00:00.000+00:00
[2024-01-07 13:22:37.725 +0000] INFO: Scheduler computeReadingScheduler started with pattern */2 * * * *
[2024-01-07 13:22:37.726 +0000] INFO: Next run: 2024-01-07T13:24:00.000+00:00
[2024-01-07 13:22:37.726 +0000] INFO: Scheduler computeSuggesterScheduler started with pattern 0 1 * * *
[2024-01-07 13:22:37.727 +0000] INFO: Next run: 2024-01-08T01:00:00.000+00:00
[2024-01-07 13:22:37.751 +0000] INFO: Processing maintenance job.
[2024-01-07 13:22:38.758 +0000] INFO: Execution time: 0s 16523007ns
[2024-01-07 13:23:10.010 +0000] INFO: Processing manga import job for 'Nyanta to Pomeko ~Imasara Shinjiteiru to Iwarete mo Mouteokureda~'.
[2024-01-07 13:23:10.381 +0000] INFO: mangadex: Found manga for ID: 63ea21e4-5ea8-4f73-87e1-ddf10563650c
[2024-01-07 13:23:10.412 +0000] INFO: anilist: Found manga for ID: 139966
[2024-01-07 13:23:14.577 +0000] INFO: kitsu: Found manga for ID: 61433
[2024-01-07 13:23:15.584 +0000] INFO: mangaupdates: Found manga for ID: 50954169414
[2024-01-07 13:23:16.099 +0000] INFO: mal: Found manga for ID: 141506
[2024-01-07 13:23:16.669 +0000] ERROR: Goodreads API key not set
[2024-01-07 13:23:16.676 +0000] WARN: goodreads getMangaByName - Not found: Nyanta to Pomeko Imasara Shinjite Iru to Iwaretemo Mou Teokure da, 2021
[2024-01-07 13:23:16.806 +0000] WARN: bato getMangaByName - Not found: Nyanta to Pomeko Imasara Shinjite Iru to Iwaretemo Mou Teokure da, 2021
[2024-01-07 13:23:18.807 +0000] INFO: Execution time: 0s 8605471ns
[2024-01-07 13:23:20.634 +0000] INFO: mangakakalot: Found manga for ID: mg989963
[2024-01-07 13:23:20.643 +0000] INFO: mangakakalot getMangaByName - Found: Nyanta And Pomeko – Even If You Say You Believe Me Now, It’S Too Late.. Query: Nyanta to Pomeko Imasara Shinjite Iru to Iwaretemo Mou Teokure da, 2021
[2024-01-07 13:23:20.850 +0000] INFO: Execution time: 0s 12172878ns
[2024-01-07 13:23:21.223 +0000] WARN: mangapill getMangaByName - Not found: Nyanta to Pomeko Imasara Shinjite Iru to Iwaretemo Mou Teokure da, 2021
[2024-01-07 13:23:21.628 +0000] INFO: Execution time: 0s 3771340ns
[2024-01-07 13:23:22.752 +0000] WARN: comickfun getMangaByName - Not found: Nyanta to Pomeko Imasara Shinjite Iru to Iwaretemo Mou Teokure da, 2021
[2024-01-07 13:23:23.891 +0000] WARN: nautiljon getMangaByName - Not found: Nyanta to Pomeko Imasara Shinjite Iru to Iwaretemo Mou Teokure da, 2021
[2024-01-07 13:23:23.914 +0000] INFO: mangadex: Looking up chapters for manga ID: 63ea21e4-5ea8-4f73-87e1-ddf10563650c
[2024-01-07 13:23:23.914 +0000] INFO: mangakakalot: Looking up chapters for manga ID: mg989963
[2024-01-07 13:23:24.985 +0000] INFO: mangakakalot: Found 19 chapters for manga ID: mg989963
[2024-01-07 13:23:25.063 +0000] INFO: mangadex: Found 74 chapters for manga ID: 63ea21e4-5ea8-4f73-87e1-ddf10563650c
[2024-01-07 13:23:25.264 +0000] INFO: 19 new chapter(s) inserted.
[2024-01-07 13:23:25.265 +0000] INFO: 19 chapter(s) updated.
[2024-01-07 13:23:25.441 +0000] ERROR: copyFile error
    err: {
      "type": "Error",
      "message": "EPERM: operation not permitted, copyfile '/data/medias/covers/13f7d91a-77dc-4f11-8224-c79f68c1e98e.tmp' -> '/data/medias/covers/603befe6-07dc-4d5c-8399-764738780ddf.jpg'",
      "stack":
          Error: EPERM: operation not permitted, copyfile '/data/medias/covers/13f7d91a-77dc-4f11-8224-c79f68c1e98e.tmp' -> '/data/medias/covers/603befe6-07dc-4d5c-8399-764738780ddf.jpg'
      "errno": -1,
      "code": "EPERM",
      "syscall": "copyfile",
      "path": "/data/medias/covers/13f7d91a-77dc-4f11-8224-c79f68c1e98e.tmp",
      "dest": "/data/medias/covers/603befe6-07dc-4d5c-8399-764738780ddf.jpg"
    }
[2024-01-07 13:29:44.135 +0000] INFO: Execution time: 0s 15112501ns
[2024-01-07 13:33:00.008 +0000] INFO: Processing maintenance job.
[2024-01-07 13:33:10.004 +0000] ERROR: Job processing timed out for worker 'MangaImportWorker'.
[2024-01-07 13:33:10.004 +0000] ERROR: Error processing job in queue 'mangaImportQueue'
    err: {
      "type": "TimeoutError",
      "message": "Job execution timed out.",
      "stack":
          TimeoutError: Job execution timed out.
              at Timeout.<anonymous> (/app/src/libra/queues/Queue.js:219:18)
              at listOnTimeout (node:internal/timers:573:17)
              at process.processTimers (node:internal/timers:514:7)
      "name": "TimeoutError"
    }

Platform

desktop

Device

NAS

Operating System

Linux

Browser

Chrome

Additional Context

version: "3.8"

services: teemii-frontend: image: dokkaner/teemii-frontend:latest ports:

Code of Conduct