search

facebook / mysql-5.6

Facebook's branch of the Oracle MySQL database. This includes MyRocks.
http://myrocks.io
Other
2.48k stars 712 forks source link

mysqld crashed when running benchmarksql #929

Open louishust opened 5 years ago

louishust commented 5 years ago

I use benchmarksql to test myrocks, under 32,64 concurrency, it's ok, but under 128 concurrency, mysqld crashed. More details below:

MyRocks: [root@ceph4 mysql-5.6]# git show commit 3ed8b062eaacb2a8dd9616bbf4d3f267af7ba91e Author: Vinaykumar Bhat vinaybhat@fb.com Date: Mon Jan 7 13:50:48 2019 -0800

RocksDB: commit 97773d0967c9eb3140280b621b21b11192bc8ae2 Author: Yanqin Jin yanqin@fb.com Date: Mon Jan 7 10:18:58 2019 -0800

my.cnf file : mycnf

Error log file(include a stack)：mysql_err.log

How to repeat:

use the mysql branch of benchmarksql and use the props file.

  1. init data 
    time ./runDatabaseBuild.sh props.rocksdb
  2. run test 
    ./runBenchmark.sh props.rocksdb
hermanlee commented 5 years ago

Are you building mysqld with jemalloc? It looks like the process hit memory limits:

2019-01-13 22:47:10 33750 [Note] RocksDB: Begin index creation (0,292) 2019-01-14 10:08:59 33750 [ERROR] ./bin/mysqld: Out of memory (Needed 126992 bytes)

louishust commented 5 years ago

Not use jemalloc, but the monitor of memory free is enough image

Today i run mysqld with jemalloc about 30mins, the OOM not happaned again.