itzg / docker-mc-backup

Provides a side-car container to backup itzg/minecraft-server world data
https://hub.docker.com/r/itzg/mc-backup
MIT License
332 stars 52 forks source link

rclone method forces switching the us-west-1 even with a different region specified in rclone.conf. #204

Closed SmashingQuasar closed 2 months ago

SmashingQuasar commented 2 months ago

Description

When using the rclone backup method, it appears that the region is forced to us-west-1, even if the rclone.conf file has region = eu-west-3 configured. This ends up with a broken permission (obviously since the bucket does not exist).

Logs

2024-09-07 13:40:59 2024-09-07T11:40:59+0000 INFO waiting initial delay of 0...
2024-09-07 13:40:59 2024-09-07T11:40:59+0000 INFO waiting for rcon readiness...
2024-09-07 13:40:59 2024-09-07T11:40:59+0000 INFO Command executed successfully rcon-cli save-on
2024-09-07 13:40:59 2024-09-07T11:40:59+0000 INFO Command executed successfully rcon-cli save-off
2024-09-07 13:41:00 2024-09-07T11:41:00+0000 INFO Command executed successfully rcon-cli save-all flush
2024-09-07 13:41:00 2024-09-07T11:41:00+0000 INFO Command executed successfully sync
2024-09-07 13:41:00 2024-09-07T11:41:00+0000 INFO Backing up content in /data to /backups/gtnh-world-20240907-114100.tgz
2024-09-07 13:41:02 2024/09/07 11:41:02 NOTICE: S3 bucket tmp path gtnh-world: Switched region to "us-west-1" from "eu-west-3"
2024-09-07 13:41:02 2024/09/07 11:41:02 ERROR : Attempt 1/3 failed with 1 errors and: Forbidden: Forbidden
2024-09-07 13:41:02     status code: 403, request id: E7CD4PDPYSK8M5DJ, host id: mQnIrtWNP7lZltHdp8vXDIEDIirJfUcjjz+2/HK/BxYQQP+K84Ivm7qV6vHTeUQLJaq0Jb423as=
2024-09-07 13:41:02 2024/09/07 11:41:02 ERROR : Attempt 2/3 failed with 1 errors and: Forbidden: Forbidden
2024-09-07 13:41:02     status code: 403, request id: E7CEBQBPHG92V4WZ, host id: 1BOz0NyJlUzRU8U0iobZWnrPwLryxWsnnfO6QqFWv7BIIkhPtkpz4+LbSj1PLaxAEo2h180c9TY=
2024-09-07 13:41:02 2024/09/07 11:41:02 ERROR : Attempt 3/3 failed with 1 errors and: Forbidden: Forbidden
2024-09-07 13:41:02     status code: 403, request id: YRGVG79FSBT22NCG, host id: Rno8HZgyO6BjXbzVSfNuJP4PX1qoWz0UuxLBvJzMfnFbKWJ+45ZyvCfo4/51ICslMGTq8Uyar9Y=
2024-09-07 13:41:02 2024/09/07 11:41:02 Failed to copy: Forbidden: Forbidden
2024-09-07 13:41:02     status code: 403, request id: YRGVG79FSBT22NCG, host id: Rno8HZgyO6BjXbzVSfNuJP4PX1qoWz0UuxLBvJzMfnFbKWJ+45ZyvCfo4/51ICslMGTq8Uyar9Y=
2024-09-07 13:41:02 2024-09-07T11:41:02+0000 ERROR rclone copy operation failed -- will retry next time
2024-09-07 13:41:02 2024-09-07T11:41:02+0000 INFO Command executed successfully rcon-cli save-on
2024-09-07 13:41:02 2024/09/07 11:41:02 NOTICE: S3 bucket tmp path gtnh-world: Switched region to "us-west-1" from "eu-west-3"
2024-09-07 13:41:03 2024/09/07 11:41:03 ERROR : : error listing: AccessDenied: Access Denied
2024-09-07 13:41:03     status code: 403, request id: YRGR00AC928QDE1P, host id: 8CbClrbuRKb2PANQTCPe1M7TBhMbcOj77genw2Jz3Qir6nbltEvKye5DQ4ZI9YOUy6M3uM3pjvA=
2024-09-07 13:41:03 2024/09/07 11:41:03 Failed to lsf with 2 errors: last error was: error in ListJSON: AccessDenied: Access Denied
2024-09-07 13:41:03     status code: 403, request id: YRGR00AC928QDE1P, host id: 8CbClrbuRKb2PANQTCPe1M7TBhMbcOj77genw2Jz3Qir6nbltEvKye5DQ4ZI9YOUy6M3uM3pjvA=
2024-09-07 13:41:03 2024-09-07T11:41:03+0000 INFO sleeping 1h...
itzg commented 2 months ago

I'm not sure how that could be done since the script uses a pretty simple rclone copy command

https://github.com/itzg/docker-mc-backup/blob/18cc11b1fa4f7a751f41ababa4ce8f8d2cc22953/scripts/opt/backup-loop.sh#L493

Let me know if there's any specific changes you'd like to see made there.

SmashingQuasar commented 2 months ago

I'm not sure how that could be done since the script uses a pretty simple rclone copy command

https://github.com/itzg/docker-mc-backup/blob/18cc11b1fa4f7a751f41ababa4ce8f8d2cc22953/scripts/opt/backup-loop.sh#L493

Let me know if there's any specific changes you'd like to see made there.

Hey, thanks for the answer!

This means it is probably a bug within rclone. I think I'll just mount a bucket on my server and put the backup within the mounted bucket.