apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.61k stars 3.25k forks source link

[Bug] Doris benchmark data run failed with buffer overflow detected #7833

Open HackToday opened 2 years ago

HackToday commented 2 years ago

Search before asking

Version

version: trunk 4768dd4efa7f6fb87e160809b37ce542ba9c0531

What's Wrong?

执行 https://github.com/apache/incubator-doris/blob/master/docs/zh-CN/benchmark/star-schema-benchmark.md 压测, 环境是: Ubuntu 20.04.3 LTS

*************************** 1. row ***************************
            BackendId: 10002
              Cluster: default_cluster
                   IP: xx.xx.xx.xx
             HostName: xx.xx.xx.xx
        HeartbeatPort: 9050
               BePort: 9060
             HttpPort: 8040
             BrpcPort: 8060
        LastStartTime: 2022-01-21 09:06:27
        LastHeartbeat: 2022-01-21 09:18:06
                Alive: true
 SystemDecommissioned: false
ClusterDecommissioned: false
            TabletNum: 40
     DataUsedCapacity: 0.000
        AvailCapacity: 866.386 GB
        TotalCapacity: 915.891 GB
              UsedPct: 5.41 %
       MaxDiskUsedPct: 5.41 %
                  Tag: {"location" : "default"}
               ErrMsg:
              Version: trunk-4768dd4
               Status: {"lastSuccessReportTabletsTime":"2022-01-21 09:17:08","lastStreamLoadTime":-1,"isQueryDisabled":false,"isLoadDisabled":false}

创建表可以正常操作没有问题, 但是执行 ssb benchmark 会出现如下的错误:

Scale Factor: 100
Parallelism: 100
Begin to generate data for table: customer
SSBM (Star Schema Benchmark) Population Generator (Version 1.0.0)
Copyright Transaction Processing Performance Council 1994 - 2000
Begin to generate data for table: part
SSBM (Star Schema Benchmark) Population Generator (Version 1.0.0)
Copyright Transaction Processing Performance Council 1994 - 2000
Begin to generate data for table: supplier
SSBM (Star Schema Benchmark) Population Generator (Version 1.0.0)
Copyright Transaction Processing Performance Council 1994 - 2000
Begin to generate data for table: date
SSBM (Star Schema Benchmark) Population Generator (Version 1.0.0)
Copyright Transaction Processing Performance Council 1994 - 2000
Begin to generate data for table: lineorder
SSBM (Star Schema Benchmark) Population Generator (Version 1.0.0)
Copyright Transaction Processing Performance Council 1994 - 2000
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated
*** buffer overflow detected ***: terminated

The log for FE and BE not have any special errors.

What You Expected?

执行 sh gen-ssb-data.sh -s 100 -c 100 正常,没有错误

How to Reproduce?

  1. 使用最新的 docker 镜像 build Doris
  2. 配置 FE 和 BE,并且启动
  3. 执行 benchmark 在一台配置尽量高的机器上。

Anything Else?

No response

Are you willing to submit PR?

Code of Conduct

HackToday commented 2 years ago

应该是 buffer 的问题,从这里看到

https://stackoverflow.com/questions/29451640/cant-manage-to-get-the-star-schema-dbms-benchmark-data-generator-to-run-properl

但是咱们引用的还是老的,运行的话就会报错,这里为什么不更新呢?

dataalive commented 2 years ago

应该是 buffer 的问题,从这里看到

https://stackoverflow.com/questions/29451640/cant-manage-to-get-the-star-schema-dbms-benchmark-data-generator-to-run-properl

但是咱们引用的还是老的,运行的话就会报错,这里为什么不更新呢?

这个是要改,我也遇到了。已经反馈

sunweifang commented 11 months ago

想问一下这个问题现在有解决吗?我也遇到了一样的问题。