intel-cloud / cosbench

a benchmark tool for cloud object storage service
Other
573 stars 240 forks source link

does cosbench support testing gcs? #431

Open nvliyuan opened 1 year ago

nvliyuan commented 1 year ago

I download the 0.4.2.c4 version and want to use it to do benchmark on gcs(google cloud storage), but after I start the service and config the xml files and submit a job, I got below error:

================================================== stage: s1-init ==================================================
---------------------------------- mission: null, driver: driver1 ----------------------------------
[N/A]================================================== stage: s2-prepare ==================================================
================================================== stage: s3-main ==================================================
================================================== stage: s4-cleanup ==================================================
================================================== stage: s5-dispose ==================================================

It works well when I test on Tencent COS according to this guide,https://cloud.tencent.com/document/product/436/47974 any idea about the issue on gcs? belows are my xml config:

<?xml version="1.0" encoding="UTF-8" ?>
<workload name="gcs-sample" description="sample benchmark for Google Cloud Storage">

  <!-- Authentication needs service account credentials. -->
  <!-- Sample credential file: ./release/conf/gcs-service-account-sample.json -->
  <storage type="gcs" config="projectid=xxx;jsonkeyfile=/xxx/gcs-key.json" />

  <workflow>

    <workstage name="init">
      <work type="init" workers="1" config="cprefix=gcstestqwer;containers=r(1,1)" />
    </workstage>

    <workstage name="prepare">
      <work type="prepare" workers="32" config="cprefix=gcstestqwer;containers=r(1,1);objects=r(1,1000);sizes=c(50)MB" />
    </workstage>

    <workstage name="main">
      <work name="main" workers="32" runtime="60">
        <operation type="read" ratio="50" config="cprefix=gcstestqwer;containers=u(1,1);objects=u(1,1000)" />
        <operation type="write" ratio="50" config="cprefix=gcstestqwer;containers=u(1,1);objects=u(1000,2000);sizes=c(50)MB" />
      </work>
    </workstage>

    <workstage name="cleanup">
      <work type="cleanup" workers="1" config="cprefix=gcstestqwer;containers=r(1,1);objects=r(1,2000)" />
    </workstage>

    <workstage name="dispose">
      <work type="dispose" workers="1" config="cprefix=gcstestqwer;containers=r(1,1)" />
    </workstage>

  </workflow>

</workload>

and I confirmed that the gcs-key.json is configed well

kisscelia commented 1 year ago

any errors in driver logs? libs.log, system.log, and mission logs?

I don't know whether or not the gcs-key.json file was not found.