search

ArchiveTeam / seesaw-kit

Making a reusable toolkit for writing seesaw scripts
Other
69 stars 30 forks source link

ArchiveTeamWarriors stuck at uploading. #145

Closed Deses closed 11 months ago

Deses commented 11 months ago

Hi! I installed the docker container on my Unraid system but the uploads are getting stuck. All my workers have been like that for hours.

I'm using this docker image: atdr.meo.ws/archiveteam/warrior-dockerfile:latest and this is the support page in the unraids forums.

One of the warrior's log:

Starting RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
@ERROR: max connections (-1) reached -- try again later
rsync error: error starting client-server protocol (code 5) at main.c(1817) [sender=3.2.3]
Process RsyncUpload returned exit code 5 for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Failed RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Retrying after 60 seconds...
Uploading with Rsync to rsync://optane9.targets.atinfra.net:8888/ateam-airsync/X/
Starting RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
@ERROR: max connections (-1) reached -- try again later
rsync error: error starting client-server protocol (code 5) at main.c(1817) [sender=3.2.3]
Process RsyncUpload returned exit code 5 for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Failed RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Retrying after 60 seconds...
Uploading with Rsync to rsync://optane9.targets.atinfra.net:8888/ateam-airsync/X/
Starting RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
@ERROR: max connections (-1) reached -- try again later
rsync error: error starting client-server protocol (code 5) at main.c(1817) [sender=3.2.3]
Process RsyncUpload returned exit code 5 for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Failed RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Retrying after 60 seconds...
Uploading with Rsync to rsync://optane9.targets.atinfra.net:8888/ateam-airsync/X/
Starting RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
@ERROR: max connections (-1) reached -- try again later
rsync error: error starting client-server protocol (code 5) at main.c(1817) [sender=3.2.3]
Process RsyncUpload returned exit code 5 for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Failed RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
Retrying after 60 seconds...
Uploading with Rsync to rsync://optane9.targets.atinfra.net:8888/ateam-airsync/X/
Starting RsyncUpload for Item comment:k1fikrbcomment:k1e5xkscomment:k1fdxsgcomment:k1f9xp7post:16nou61comment:k1fsohgcomment:k1fis2ycomment:k1fao93comment:k1fj4d4comment:k1fto1ucomment:k1fqemdpost:16npob3comment:k1ft3e5comment:k1fug7fcomment:k1ft5x2comment:k1fccpmcomment:k1f3zbkpost:16nld6ecomment:k1ef7ur
@ERROR: max connections (-1) reached -- try again later
rsync error: error starting client-server protocol (code 5) at main.c(1817) [sender=3.2.3]
Process RsyncUpload returned exit code 5 for Item
TheTechRobo commented 11 months ago

This is known. It occurs when the upload servers' storage is full. AT's infra is overloaded so it will happen more than usual for now. It will pass in time.

Deses commented 11 months ago

Where can I see this so I (or other people) don't make the same questions? I tried to find some server status somewhere but I wasn't able to.

Maybe adding a more descriptive error to the Warriors would be a nice to have. Something like "Servers are full, retrying in an hour".

Thank you.

TheTechRobo commented 11 months ago

Maybe adding a more descriptive error to the Warriors would be a nice to have. Something like "Servers are full, retrying in an hour".

This is a common request, and it's a good idea. However, development on this framework has stalled (there's always more stuff to archive!) so it hasn't been implemented yet. (Take what I say with a grain of salt, though, as i'm not an AT developer.)