intel-cloud / cosbench

a benchmark tool for cloud object storage service
Other
573 stars 242 forks source link

Cosbench v0.4.3.0 (Hitachi version) not sending AWS S3 v4 signature authorization #429

Open mdtowle opened 2 years ago

mdtowle commented 2 years ago

Based on the solution provided in https://github.com/intel-cloud/cosbench/issues/307 I tried using Cosbench v0.4.3.0 to send AWS S3 v4 signature authorization, but I'm getting 400 responses back from an S3-compatible cloud storage service. The errors say "The V2 signature authorization mechanism you have provided is not supported. Please use AWS-HMAC-SHA256." In my Cosbench workload config file, I have the following as the storage type:

storage type="s3" config="path_style_access=true;accesskey=access-key;secretkey=secret-key;endpoint=https://s3-compatible-server;proxyhost=127.0.0.1;proxyport=8080;signer_version=V4"

I've tried adding "-Dcom.amazonaws.services.s3.enableV4" to the java line in cosbench-start.sh, to no avail.

I thought v0.4.3.0 added support for AWS s3 v4 signature authorization. Does anyone know how to get Cosbench to send v4?

I'm running Cosbench on a Ubuntu 22.04 server. I've tried with JDK 11, 8, and 7. I have a proxy from mitmproxy.org running on the server so I can see the requests and responses in plaintext.

Thanks.

kisscelia commented 1 year ago

can you try to use the v0.5.0.0 version? The aws-sdk-java version was updated to 1.12.528, AWS S3 V4 signature was default.

you can try it on centos7.9 or ubuntu 16.04LTS thanks. 😸