zmanda / amanda

Amanda Network Backup
https://www.zmanda.com/downloads/
Other
214 stars 107 forks source link

Amazon S3 errors since upgrade from 3.3.9 to 3.5.1 #213

Open brianamos1 opened 1 year ago

brianamos1 commented 1 year ago

I started getting the following error after upgrading my server os, which included upgrading from Amanda 3.3.9 to 3.5.1. After the error I uninstalled 3.5.1 and built 3.5.2 from source. I continue getting the same error. The error says:

While writing amanda header: The request signature we calculated does not match the signature you provided. Check your key and signing method. (SignatureDoesNotMatch) (HTTP 403).

I have checked my access key and secret key, and they are correct. I tried using new keys (on both root account and and that also didn't make any difference. I've tried changing the device properties to various different settings with no luck. I've even tried starting a new backup, both from scratch and from the S3 template. I updated my device definition per the man page and that hasn't worked either. Has anyone seen this issue? Or have any advice ?

All of my searching on google doesn't turn anything up, and with the zmanda forums down, I don't know where go to but here. I've skimmed the code and gone through the s3 files, but with no familiarity with this code base, I don't know where to look for the issue. I am wondering if it's an issue with curl or some other library that is the culprit and not amanda. I'm just looking if anyone has experience this or has any direction where I can look to fix this.

brianamos1 commented 1 year ago

I can report that this is not an issue with the 3_6 branch, but it is an issue with the main branch.

hubandr commented 1 year ago

had the same problem a few weeks ago. Downgrading of the latest curl security fixes solved the problem (for now).

On Debian 10: apt install libcurl4=7.64.0-4+deb10u2 curl=7.64.0-4+deb10u2

Gouagou commented 1 year ago

Same problem on Debian 11.6 Downgrading solve the problem: apt install libcurl4=7.74.0-1.3+deb11u3 curl=7.74.0-1.3+deb11u3

shrodi commented 1 year ago

Same problem on Ubuntu 22.04 LTS.

Downgrading libcurl4 from 7.81.0-1ubuntu1.10 to 7.81.0-1 solved the problem for me: apt install libcurl4=7.81.0-1

I put the package on hold for now: apt-mark hold libcurl4

stefangweichinger commented 1 year ago

Same problem on Debian 11.6 Downgrading solve the problem: apt install libcurl4=7.74.0-1.3+deb11u3 curl=7.74.0-1.3+deb11u3

"...deb11u7" for Debian 11.7 in the meantime

Unfortunately this doesn't fix things for me right now.

slot 1: Can't read label: While trying to read tapestart header: The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method. (SignatureDoesNotMatch) (HTTP 403)
brianamos1 commented 1 year ago

I ended up compiling Amanda from the 3.6.0.pre3+1 version, and it works great with the up to date libcurl. I back up to Amazon not Google though, backing up to google may have different results.

On Jun 2, 2023, at 3:10 AM, Stefan G. Weichinger @.***> wrote:



Same problem on Debian 11.6 Downgrading solve the problem: apt install libcurl4=7.74.0-1.3+deb11u3 curl=7.74.0-1.3+deb11u3

"...deb11u7" for Debian 11.7 in the meantime

Unfortunately this doesn't fix things for me right now.

slot 1: Can't read label: While trying to read tapestart header: The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method. (SignatureDoesNotMatch) (HTTP 403)

— Reply to this email directly, view it on GitHub https://github.com/zmanda/amanda/issues/213#issuecomment-1573410172 , or unsubscribe https://github.com/notifications/unsubscribe-auth/ACWXUHLG2JQNCFOUNXQBQDTXJGUXPANCNFSM6AAAAAAWAMKT3I . You are receiving this because you authored the thread. https://github.com/notifications/beacon/ACWXUHNGRULM6F6E6R6XQADXJGUXPA5CNFSM6AAAAAAWAMKT3KWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTS5ZBKXY.gif Message ID: @.***>

chassell commented 1 year ago

Google wasn't working well and they've changed their protocol several times.

It needs work.

On Fri, Jun 2, 2023, 5:12 AM Brian Amos @.***> wrote:

I ended up compiling Amanda from the 3.6.0.pre3+1 version, and it works great with the up to date libcurl. I back up to Amazon not Google though, backing up to google may have different results.

On Jun 2, 2023, at 3:10 AM, Stefan G. Weichinger @.***> wrote:



Same problem on Debian 11.6 Downgrading solve the problem: apt install libcurl4=7.74.0-1.3+deb11u3 curl=7.74.0-1.3+deb11u3

"...deb11u7" for Debian 11.7 in the meantime

Unfortunately this doesn't fix things for me right now.

slot 1: Can't read label: While trying to read tapestart header: The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method. (SignatureDoesNotMatch) (HTTP 403)

— Reply to this email directly, view it on GitHub < https://github.com/zmanda/amanda/issues/213#issuecomment-1573410172> , or unsubscribe < https://github.com/notifications/unsubscribe-auth/ACWXUHLG2JQNCFOUNXQBQDTXJGUXPANCNFSM6AAAAAAWAMKT3I> . You are receiving this because you authored the thread. < https://github.com/notifications/beacon/ACWXUHNGRULM6F6E6R6XQADXJGUXPA5CNFSM6AAAAAAWAMKT3KWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTS5ZBKXY.gif> Message ID: @.***>

— Reply to this email directly, view it on GitHub https://github.com/zmanda/amanda/issues/213#issuecomment-1573638067, or unsubscribe https://github.com/notifications/unsubscribe-auth/AG4RPLRNZXBS6AP4RMWMXKLXJHKCVANCNFSM6AAAAAAWAMKT3I . You are receiving this because you are subscribed to this thread.Message ID: @.***>

stefangweichinger commented 1 year ago

Google wasn't working well and they've changed their protocol several times. It needs work.

@chassell thanks for that short bit. Sounds as if I have to look for something else.

stefangweichinger commented 1 year ago

Google wasn't working well and they've changed their protocol several times. It needs work.

@chassell Does that mean that also 3_6 can not be trusted with the S3 device currently? Could you explain in more detail what does not work well? I invested lots of time in trying to make this work here and have to decide how to proceed. Thanks.

Gouagou commented 1 year ago

I have equally try the 3.6.0.pre3+1 version, amdump is working. But amrecover failed, only the folders are restored . And the job never finished...

----- Le 2 Juin 23, à 14:12, Brian Amos @.***> a écrit :

I ended up compiling Amanda from the 3.6.0.pre3+1 version, and it works great with the up to date libcurl. I back up to Amazon not Google though, backing up to google may have different results.

On Jun 2, 2023, at 3:10 AM, Stefan G. Weichinger @.***> wrote:

Same problem on Debian 11.6 Downgrading solve the problem: apt install libcurl4=7.74.0-1.3+deb11u3 curl=7.74.0-1.3+deb11u3

"...deb11u7" for Debian 11.7 in the meantime

Unfortunately this doesn't fix things for me right now.

slot 1: Can't read label: While trying to read tapestart header: The request signature we calculated does not match the signature you provided. Check your Google secret key and signing method. (SignatureDoesNotMatch) (HTTP 403)

— Reply to this email directly, view it on GitHub https://github.com/zmanda/amanda/issues/213#issuecomment-1573410172 , or unsubscribe https://github.com/notifications/unsubscribe-auth/ACWXUHLG2JQNCFOUNXQBQDTXJGUXPANCNFSM6AAAAAAWAMKT3I . You are receiving this because you authored the thread. https://github.com/notifications/beacon/ACWXUHNGRULM6F6E6R6XQADXJGUXPA5CNFSM6AAAAAAWAMKT3KWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTS5ZBKXY.gif Message ID: @.***>

— Reply to this email directly, [ https://github.com/zmanda/amanda/issues/213#issuecomment-1573638067 | view it on GitHub ] , or [ https://github.com/notifications/unsubscribe-auth/AAHFS2ONDS7ZHFDER4I6UWLXJHKCPANCNFSM6AAAAAAWAMKT3I | unsubscribe ] . You are receiving this because you commented. Message ID: @.***>

-- Blaise Vogel +41 21 796 12 33 @.***

ALTUX SA Route de Lavaux 235 CH‑1095 Lutry www.altux.ch

stefangweichinger commented 1 year ago

I have equally try the 3.6.0.pre3+1 version, amdump is working. But amrecover failed, only the folders are restored . And the job never finished...

ouch! Backups without Restore aren't worth much ...

superwooman commented 11 months ago

had the same problem a few weeks ago. Downgrading of the latest curl security fixes solved the problem (for now).

On Debian 10: apt install libcurl4=7.64.0-4+deb10u2 curl=7.64.0-4+deb10u2

Same here. Tried many other things but this solution works. Thanks