search

intel-cloud / cosbench

a benchmark tool for cloud object storage service
Other
573 stars 242 forks source link

s3 https can not work correct in 0.4.2.c3 #284

Closed dwj192 closed 8 years ago

dwj192 commented 8 years ago

this is my conf

<?xml version="1.0" encoding="UTF-8" ?>
<workload name="s3-sample" description="sample benchmark for s3">

  <storage type="s3" config="accesskey=keyuser;secretkey=keyuser;endpoint=https://node106" />

  <workflow>

    <workstage name="init">
      <work type="init" workers="1" config="cprefix=s3testqwer;containers=r(1,2)" />
    </workstage>

    <workstage name="prepare">
      <work type="prepare" workers="1" config="cprefix=s3testqwer;containers=r(1,2);objects=r(1,10);sizes=c(64)KB" />
    </workstage>

    <workstage name="main">
      <work name="main" workers="8" runtime="30">
        <operation type="read" ratio="80" config="cprefix=s3testqwer;containers=u(1,2);objects=u(1,10)" />
        <operation type="write" ratio="20" config="cprefix=s3testqwer;containers=u(1,2);objects=u(11,20);sizes=c(64)KB" />
      </work>
    </workstage>

    <workstage name="cleanup">
      <work type="cleanup" workers="1" config="cprefix=s3testqwer;containers=r(1,2);objects=r(1,20)" />
    </workstage>

    <workstage name="dispose">
      <work type="dispose" workers="1" config="cprefix=s3testqwer;containers=r(1,2)" />
    </workstage>

  </workflow>

</workload>

error log

2015-10-31 11:08:01,016 [INFO] [Log4jLogManager] - will append log to file /home/ceph/0.4.2.c3/log/mission/M5BBDDB7225.log
2015-10-31 11:08:01,263 [INFO] [NoneStorage] - performing PUT at /s3testqwer1/myobjects1
2015-10-31 11:08:01,304 [WARN] [S3Storage] - below exception encountered when creating object myobjects1 at s3testqwer1: Encountered an exception and couldn't reset the stream to retry
2015-10-31 11:08:01,327 [INFO] [NoneStorage] - performing PUT at /s3testqwer1/myobjects2
2015-10-31 11:08:01,343 [WARN] [S3Storage] - below exception encountered when creating object myobjects2 at s3testqwer1: Encountered an exception and couldn't reset the stream to retry
2015-10-31 11:08:01,365 [INFO] [NoneStorage] - performing PUT at /s3testqwer1/myobjects3
2015-10-31 11:08:01,382 [WARN] [S3Storage] - below exception encountered when creating object myobjects3 at s3testqwer1: Encountered an exception and couldn't reset the stream to retry

2015-10-31 10:22:43,012 [INFO] [Log4jLogManager] - will append log to file /home/ceph/0.4.2.c3/log/mission/MFBBB43C6E6.log
2015-10-31 10:22:43,280 [INFO] [NoneStorage] - performing GET at /s3testqwer1/myobjects6
2015-10-31 10:22:43,282 [INFO] [NoneStorage] - performing GET at /s3testqwer2/myobjects2
2015-10-31 10:22:43,282 [INFO] [NoneStorage] - performing GET at /s3testqwer2/myobjects9
2015-10-31 10:22:43,282 [INFO] [NoneStorage] - performing GET at /s3testqwer2/myobjects7
2015-10-31 10:22:43,281 [INFO] [NoneStorage] - performing GET at /s3testqwer1/myobjects6
2015-10-31 10:22:43,280 [INFO] [NoneStorage] - performing GET at /s3testqwer2/myobjects1
2015-10-31 10:22:43,283 [INFO] [NoneStorage] - performing GET at /s3testqwer2/myobjects1
2015-10-31 10:22:43,282 [INFO] [NoneStorage] - performing GET at /s3testqwer2/myobjects10
2015-10-31 10:22:47,519 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects2 at bucket s3testqwer2: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,519 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects10 at bucket s3testqwer2: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,520 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects6 at bucket s3testqwer1: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,521 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects9 at bucket s3testqwer2: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,521 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects1 at bucket s3testqwer2: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,522 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects7 at bucket s3testqwer2: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,523 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects1 at bucket s3testqwer2: Unable to execute HTTP request: peer not authenticated
2015-10-31 10:22:47,524 [WARN] [S3Storage] - below exception encountered when retrieving object myobjects6 at bucket s3testqwer1: Unable to execute HTTP request: peer not authenticated
dwj192 commented 8 years ago

all stage the Bandwidth 0 B/S

ywang19 commented 8 years ago

pls see my recent update in https://github.com/intel-cloud/cosbench/issues/277