Cosbench 0.4.2.c4 errors when work against Ceph/Hammer with HAproxy/HTTPs

[jianghaitao]

I noticed that there are 2 errors

[WARN] [S3Storage] - below exception encountered when creating object write-object4520 at testbucket-f8ae72b6-2e58-4cbd-a014-05aaa15988831: Failed to reset the request input stream;  If the request involves an input stream, the maximum stream buffer size can be configured via request.getRequestClientOptions().setReadLimit(int)

and

[WARN] [S3Storage] - below exception encountered when deleting object write-object18670 at bucket testbucket-f8ae72b6-2e58-4cbd-a014-05aaa1598
8831: java.lang.InterruptedException: sleep interrupted

Any idea?

[tsg-]

I'm seeing this error as well w/ Ceph RGW S3 setup

[ywang19]

what's the workload config?

[tsg-]

<?xml version="1.0" encoding="UTF-8" ?>
<workload name="s3-sample" description="sample benchmark for s3">
  <storage type="s3" config="accesskey=001;secretkey=100;endpoint=http://ft08.intel.com:8080;retry=10;timeout=30000;" />
  <workflow>
    <workstage name="init">
      <work type="init" workers="1" config="cprefix=s3testqwer;containers=r(1,2)" />
    </workstage>
    <workstage name="prepare">
      <work type="prepare" workers="1" config="cprefix=s3testqwer;containers=r(1,2);objects=r(1,10);sizes=c(512)KB" />
    </workstage>
    <workstage name="main">
      <work name="main" workers="8" runtime="30">
        <operation type="read" ratio="80" config="cprefix=s3testqwer;containers=u(1,2);objects=u(1,10)" />
        <operation type="write" ratio="20" config="cprefix=s3testqwer;containers=u(1,2);objects=u(11,20);sizes=c(512)KB" />
      </work>
    </workstage>
    <workstage name="cleanup">
      <work type="cleanup" workers="1" config="cprefix=s3testqwer;containers=r(1,2);objects=r(1,20)" />
    </workstage>
    <workstage name="dispose">
      <work type="dispose" workers="1" config="cprefix=s3testqwer;containers=r(1,2)" />
    </workstage>
  </workflow>
</workload>

[ywang19]

Hi Tushar,

Based on your workload, I did a bit minor changes, and run against AWS, no see the error. The changes are: i) changed the information in section to meet my settings, like accesskey/secretekey/proxyhost/proxyport/enpoint. Ii) changed the cprefix from “s3testqwer” to “s3testqwer3”, as the original container prefix seems used already.

I believe you are using storage system with S3 protocol other than Amazon S3, so it’s necessary to check the backend storage system to help diagnose the issue.

-yaguang

---

<?xml version="1.0" encoding="UTF-8" ?>

From: Tushar Gohad [mailto:notifications@github.com] Sent: Wednesday, June 22, 2016 12:27 PM To: intel-cloud/cosbench cosbench@noreply.github.com Cc: Wang, Yaguang yaguang.wang@intel.com; Comment comment@noreply.github.com Subject: Re: [intel-cloud/cosbench] Cosbench 0.4.2.c4 errors when work against Ceph/Hammer with HAproxy/HTTPs (#321)

<?xml version="1.0" encoding="UTF-8" ?>

``` ```

— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/intel-cloud/cosbench/issues/321#issuecomment-227639952, or mute the threadhttps://github.com/notifications/unsubscribe/ADCRxdPS9QBiEU7yeH5VEakqRH0fugaOks5qOLmsgaJpZM4I32GL.