ArchiveTeam / seesaw-kit

Making a reusable toolkit for writing seesaw scripts
Other
69 stars 30 forks source link

Reddit seems to be unable to update #139

Closed rmonk closed 1 year ago

rmonk commented 1 year ago

When starting it in a container, it ran for quite some time but then I saw: Project code is out of date and needs to be upgraded. To remedy this problem immediately, you may reboot your warrior.

I switched away and back to the reddit project and it still does it, even restarting the container (which has no persistent storage) causes it. I see in the logs:

2023-06-12 20:19:31,920 - root - INFO - Logging to /home/warrior/data/warrior.log
2023-06-12 20:19:31,924 - seesaw.warrior - DEBUG - Update warrior hq.
2023-06-12 20:19:31,925 - seesaw.warrior - DEBUG - Warrior ID ''.
2023-06-12 20:19:32,400 - seesaw.warrior - DEBUG - Select project reddit
2023-06-12 20:19:32,400 - seesaw.warrior - DEBUG - Start selected project reddit (reinstall=False)
2023-06-12 20:19:32,401 - seesaw.warrior - DEBUG - Install project reddit
2023-06-12 20:19:32,401 - seesaw.warrior - DEBUG - git clone
2023-06-12 20:19:32,982 - seesaw.warrior - DEBUG - git operation: Cloning into '/home/warrior/projects/reddit'...

2023-06-12 20:19:32,983 - seesaw.warrior - DEBUG - Install complete Cloning into '/home/warrior/projects/reddit'...

2023-06-12 20:19:32,984 - seesaw.warrior - DEBUG - Result of the install process: True
2023-06-12 20:19:32,984 - seesaw.warrior - DEBUG - Clone project reddit /home/warrior/projects/reddit
2023-06-12 20:19:32,987 - seesaw.warrior - DEBUG - Cloning version 57adbb3
Cloning into '/home/warrior/data/projects/reddit-57adbb3'...
done.
2023-06-12 20:19:33,009 - seesaw.warrior - DEBUG - Load pipeline /home/warrior/data/projects/reddit-57adbb3/pipeline.py
2023-06-12 20:19:33,009 - seesaw.warrior - DEBUG - Pipeline has been read. Begin ConfigValue collection
2023-06-12 20:19:33,009 - seesaw.warrior - DEBUG - Executing pipeline
2023-06-12 20:19:33,064 - seesaw.warrior - DEBUG - Stopped ConfigValue collecting
2023-06-12 20:19:33,064 - seesaw.warrior - INFO - Project reddit installed

I got a similar error as https://github.com/ArchiveTeam/reddit-grab/issues/16 and tried restarting to fix it, and then this started.

container-compose:

version: "3"
services:
  archiveTeamWarrior:
    image: atdr.meo.ws/archiveteam/warrior-dockerfile
    container_name: archiveTeamWarrior
    hostname: archiveTeamWarrior
    ports:
      - "8001:8001"
    restart: unless-stopped
    environment:
      - SELECTED_PROJECT=auto
      - SHARED_RSYNC_THREADS=20
      - CONCURRENT_ITEMS=6
      - HTTP_USERNAME=<NAME>
      - HTTP_PASSWORD=<PASS>
      - DOWNLOADER=<MY_HANDLE>
niuhomelab commented 1 year ago

Experiencing this problem on Reddit, Imgur, and Stack Exchange project too

rmonk commented 1 year ago

I checked on the #shreddit IRC channel and this is "no work needed" or pause mode. It should be back soon.