can not do training - Githubissues

billbargens commented 7 years ago

Environment info

Operating System: CentOS7 GPU: NVIDIA Tesla K80
Driver Version: 352.39

Configurations

Following the introduction, I set the additional parameters: device = gpu gpu_platform_id = 0 gpu_device_id = 0

Error Message

[LightGBM] [Info] Finished loading parameters [LightGBM] [Info] Saving data to binary file /disk1/user_tags/1.txt.bin [LightGBM] [Info] Saving data to binary file /disk1/user_tags/test.txt.bin [LightGBM] [Info] Finished loading data in 66.895618 seconds [LightGBM] [Info] Number of positive: 100694, number of negative: 99742 [LightGBM] [Info] This is the GPU trainer!! [LightGBM] [Info] Total Bins 51742 [LightGBM] [Info] Number of data: 200436, number of used features: 25871 [LightGBM] [Info] Using requested OpenCL platform 0 device 0 [LightGBM] [Info] Using GPU Device: Tesla K80, Vendor: NVIDIA Corporation [LightGBM] [Info] Compiling OpenCL Kernel with 16 bins... Segmentation fault (core dumped)

wxchan commented 7 years ago

try https://github.com/Microsoft/LightGBM/issues/389#issuecomment-293199730

billbargens commented 7 years ago

It seems to be not the same problem

Install

I use the custom boost lib path and cmake module path:

/disk1/lib/cmake/bin/cmake -DUSE_GPU=1 -DBOOST_ROOT=/disk1/lib/boost_1_62 -DOpenCL_LIBRARY=/usr/local/cuda/lib64/libOpenCL.so -DOpenCL_INCLUDE_DIR=/usr/local/cuda/include -DCMAKE_MODULE_PATH=/disk1/lib/cmake/ ..

And the cmake process succeeded:

-- The C compiler identification is GNU 4.8.5 -- The CXX compiler identification is GNU 4.8.5 -- Check for working C compiler: /usr/bin/cc -- Check for working C compiler: /usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /usr/bin/c++ -- Check for working CXX compiler: /usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- Try OpenMP C flag = [-fopenmp] -- Performing Test OpenMP_FLAG_DETECTED -- Performing Test OpenMP_FLAG_DETECTED - Success -- Try OpenMP CXX flag = [-fopenmp] -- Performing Test OpenMP_FLAG_DETECTED -- Performing Test OpenMP_FLAG_DETECTED - Success -- Found OpenMP: -fopenmp
-- Looking for CL_VERSION_2_0 -- Looking for CL_VERSION_2_0 - not found -- Looking for CL_VERSION_1_2 -- Looking for CL_VERSION_1_2 - found -- Found OpenCL: /usr/local/cuda/lib64/libOpenCL.so (found version "1.2") -- OpenCL include directory:/usr/local/cuda/include -- Boost version: 1.62.0 -- Found the following Boost libraries: -- filesystem -- system -- Configuring done -- Generating done -- Build files have been written to: /disk1/lib/LightGBM/build

make

Scanning dependencies of target _lightgbm [ 2%] Building CXX object CMakeFiles/_lightgbm.dir/src/c_api.cpp.o [ 4%] Building CXX object CMakeFiles/_lightgbm.dir/src/application/application.cpp.o [ 6%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/boosting.cpp.o [ 8%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/gbdt.cpp.o [ 10%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/bin.cpp.o [ 12%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/config.cpp.o [ 14%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/dataset.cpp.o [ 16%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/dataset_loader.cpp.o [ 18%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/metadata.cpp.o [ 20%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/parser.cpp.o [ 22%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/tree.cpp.o [ 24%] Building CXX object CMakeFiles/_lightgbm.dir/src/metric/dcg_calculator.cpp.o [ 26%] Building CXX object CMakeFiles/_lightgbm.dir/src/metric/metric.cpp.o [ 28%] Building CXX object CMakeFiles/_lightgbm.dir/src/objective/objective_function.cpp.o [ 30%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linker_topo.cpp.o [ 32%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linkers_mpi.cpp.o [ 34%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linkers_socket.cpp.o [ 36%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/network.cpp.o [ 38%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o [ 40%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o [ 42%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o [ 44%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o [ 46%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/tree_learner.cpp.o [ 48%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o [ 50%] Linking CXX shared library ../lib_lightgbm.so [ 50%] Built target _lightgbm Scanning dependencies of target lightgbm [ 52%] Building CXX object CMakeFiles/lightgbm.dir/src/main.cpp.o [ 54%] Building CXX object CMakeFiles/lightgbm.dir/src/application/application.cpp.o [ 56%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/boosting.cpp.o [ 58%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/gbdt.cpp.o [ 60%] Building CXX object CMakeFiles/lightgbm.dir/src/io/bin.cpp.o [ 62%] Building CXX object CMakeFiles/lightgbm.dir/src/io/config.cpp.o [ 64%] Building CXX object CMakeFiles/lightgbm.dir/src/io/dataset.cpp.o [ 66%] Building CXX object CMakeFiles/lightgbm.dir/src/io/dataset_loader.cpp.o [ 68%] Building CXX object CMakeFiles/lightgbm.dir/src/io/metadata.cpp.o [ 70%] Building CXX object CMakeFiles/lightgbm.dir/src/io/parser.cpp.o [ 72%] Building CXX object CMakeFiles/lightgbm.dir/src/io/tree.cpp.o [ 74%] Building CXX object CMakeFiles/lightgbm.dir/src/metric/dcg_calculator.cpp.o [ 76%] Building CXX object CMakeFiles/lightgbm.dir/src/metric/metric.cpp.o [ 78%] Building CXX object CMakeFiles/lightgbm.dir/src/objective/objective_function.cpp.o [ 80%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linker_topo.cpp.o [ 82%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linkers_mpi.cpp.o [ 84%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linkers_socket.cpp.o [ 86%] Building CXX object CMakeFiles/lightgbm.dir/src/network/network.cpp.o [ 88%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o [ 90%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o [ 92%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o [ 94%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o [ 96%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/tree_learner.cpp.o [ 98%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o [100%] Linking CXX executable ../lightgbm [100%] Built target lightgbm

Training with cpu

Using the default configuration without gpu support, the training task failed with the error message:

[LightGBM] [Info] Finished loading parameters [LightGBM] [Info] Finished loading data in 67.064315 seconds [LightGBM] [Info] Number of positive: 100694, number of negative: 99742 [LightGBM] [Info] Total Bins 51742 [LightGBM] [Info] Number of data: 200436, number of used features: 25871 Error in `./lightgbm': double free or corruption (out): 0x000000029e0428e0 ======= Backtrace: ========= /lib64/libc.so.6(+0x7d053)[0x7f212b930053] ./lightgbm(_ZN8LightGBM4GBDT17ResetTrainingDataEPKNS_14BoostingConfigEPKNS_7DatasetEPKNS_17ObjectiveFunctionERKSt6vectorIPKNS_6MetricESaISD_EE+0x1248)[0x45bb58] ./lightgbm(_ZN8LightGBM11Application9InitTrainEv+0x22c)[0x44260c] ./lightgbm(main+0x2a)[0x43e79a] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7f212b8d4b15] ./lightgbm[0x43f06d] ======= Memory map: ======== 00400000-00552000 r-xp 00000000 08:11 12585186 /disk1/lib/LightGBM/lightgbm 00752000-00757000 r--p 00152000 08:11 12585186 /disk1/lib/LightGBM/lightgbm 00757000-00758000 rw-p 00157000 08:11 12585186 /disk1/lib/LightGBM/lightgbm 00b9c000-32d0a0000 rw-p 00000000 00:00 0 [heap] 7f1ce4000000-7f1ce7fd4000 rw-p 00000000 00:00 0 7f1ce7fd4000-7f1ce8000000 ---p 00000000 00:00 0 7f1ce8000000-7f1ce9326000 rw-p 00000000 00:00 0 7f1ce9326000-7f1cec000000 ---p 00000000 00:00 0 7f1cec000000-7f1ceffb7000 rw-p 00000000 00:00 0 7f1ceffb7000-7f1cf0000000 ---p 00000000 00:00 0 7f1cf0000000-7f1cf3ff7000 rw-p 00000000 00:00 0 7f1cf3ff7000-7f1cf4000000 ---p 00000000 00:00 0 7f1cf4000000-7f1cf7f5c000 rw-p 00000000 00:00 0 7f1cf7f5c000-7f1cf8000000 ---p 00000000 00:00 0 7f1cf8000000-7f1cfbf43000 rw-p 00000000 00:00 0 7f1cfbf43000-7f1cfc000000 ---p 00000000 00:00 0 7f1cfc000000-7f1cfffe7000 rw-p 00000000 00:00 0 7f1cfffe7000-7f1d00000000 ---p 00000000 00:00 0 7f1d00000000-7f1d03f7b000 rw-p 00000000 00:00 0 7f1d03f7b000-7f1d04000000 ---p 00000000 00:00 0 7f1d04000000-7f1d07f3d000 rw-p 00000000 00:00 0 7f1d07f3d000-7f1d08000000 ---p 00000000 00:00 0 7f1d08000000-7f1d0bf63000 rw-p 00000000 00:00 0 7f1d0bf63000-7f1d0c000000 ---p 00000000 00:00 0 7f1d0c000000-7f1d0ff30000 rw-p 00000000 00:00 0 7f1d0ff30000-7f1d10000000 ---p 00000000 00:00 0 7f1d10000000-7f1d13f32000 rw-p 00000000 00:00 0 7f1d13f32000-7f1d14000000 ---p 00000000 00:00 0 7f1d14000000-7f1d17fa8000 rw-p 00000000 00:00 0 7f1d17fa8000-7f1d18000000 ---p 00000000 00:00 0 7f1d18000000-7f1d1bffb000 rw-p 00000000 00:00 0 7f1d1bffb000-7f1d1c000000 ---p 00000000 00:00 0 7f1d1c000000-7f1d1ff30000 rw-p 00000000 00:00 0 7f1d1ff30000-7f1d20000000 ---p 00000000 00:00 0 7f1d20000000-7f1d23f59000 rw-p 00000000 00:00 0 7f1d23f59000-7f1d24000000 ---p 00000000 00:00 0 7f1d24000000-7f1d27fba000 rw-p 00000000 00:00 0 7f1d27fba000-7f1d28000000 ---p 00000000 00:00 0 7f1d28000000-7f1d29c1e000 rw-p 00000000 00:00 0 7f1d29c1e000-7f1d2c000000 ---p 00000000 00:00 0 7f1d2c000000-7f1d2fef7000 rw-p 00000000 00:00 0 7f1d2fef7000-7f1d30000000 ---p 00000000 00:00 0 7f1d30000000-7f1d33f1b000 rw-p 00000000 00:00 0 7f1d33f1b000-7f1d34000000 ---p 00000000 00:00 0 7f1d34000000-7f1d37ff5000 rw-p 00000000 00:00 0 7f1d37ff5000-7f1d38000000 ---p 00000000 00:00 0 7f1d38000000-7f1d3bfa8000 rw-p 00000000 00:00 0 7f1d3bfa8000-7f1d3c000000 ---p 00000000 00:00 0 7f1d3c000000-7f1d3ff1c000 rw-p 00000000 00:00 0 7f1d3ff1c000-7f1d40000000 ---p 00000000 00:00 0 7f1d40000000-7f1d43f6c000 rw-p 00000000 00:00 0 7f1d43f6c000-7f1d44000000 ---p 00000000 00:00 0 7f1d44000000-7f1d47fe8000 rw-p 00000000 00:00 0 7f1d47fe8000-7f1d48000000 ---p 00000000 00:00 0 7f1d48000000-7f1d4bfdc000 rw-p 00000000 00:00 0 7f1d4bfdc000-7f1d4c000000 ---p 00000000 00:00 0 7f1d4c000000-7f1d4ffbc000 rw-p 00000000 00:00 0 7f1d4ffbc000-7f1d50000000 ---p 00000000 00:00 0 7f1d50000000-7f1d53f68000 rw-p 00000000 00:00 0 7f1d53f68000-7f1d54000000 ---p 00000000 00:00 0 7f1d54000000-7f1d57000000 rw-p 00000000 00:00 0 7f1d57000000-7f1d58000000 ---p 00000000 00:00 0 7f1d58000000-7f1d5bf9a000 rw-p 00000000 00:00 0 7f1d5bf9a000-7f1d5c000000 ---p 00000000 00:00 0 7f1d5c000000-7f1d5ff79000 rw-p 00000000 00:00 0 7f1d5ff79000-7f1d60000000 ---p 00000000 00:00 0 7f1d60000000-7f1d63f59000 rw-p 00000000 00:00 0 7f1d63f59000-7f1d64000000 ---p 00000000 00:00 0 7f1d64000000-7f1d67fc7000 rw-p 00000000 00:00 0 7f1d67fc7000-7f1d68000000 ---p 00000000 00:00 0 7f1d68000000-7f1d68165000 rw-p 00000000 00:00 0 7f1d68165000-7f1d6c000000 ---p 00000000 00:00 0 7f1d6c000000-7f1d6ff5c000 rw-p 00000000 00:00 0 7f1d6ff5c000-7f1d70000000 ---p 00000000 00:00 0 7f1d70000000-7f1d70aff000 rw-p 00000000 00:00 0 7f1d70aff000-7f1d74000000 ---p 00000000 00:00 0 7f1d74000000-7f1d77fb1000 rw-p 00000000 00:00 0 7f1d77fb1000-7f1d78000000 ---p 00000000 00:00 0 7f1d78000000-7f1d78462000 rw-p 00000000 00:00 0 7f1d78462000-7f1d7c000000 ---p 00000000 00:00 0 7f1d7c000000-7f1d7fec9000 rw-p 00000000 00:00 0 7f1d7fec9000-7f1d80000000 ---p 00000000 00:00 0 7f1d80000000-7f1d83fa1000 rw-p 00000000 00:00 0 7f1d83fa1000-7f1d84000000 ---p 00000000 00:00 0 7f1d84000000-7f1d87f86000 rw-p 00000000 00:00 0 7f1d87f86000-7f1d88000000 ---p 00000000 00:00 0 7f1d88000000-7f1d8bec1000 rw-p 00000000 00:00 0 7f1d8bec1000-7f1d8c000000 ---p 00000000 00:00 0 7f1d8c000000-7f1d8ff6b000 rw-p 00000000 00:00 0 7f1d8ff6b000-7f1d90000000 ---p 00000000 00:00 0 7f1d90000000-7f1d90948000 rw-p 00000000 00:00 0 7f1d90948000-7f1d94000000 ---p 00000000 00:00 0 7f1d94000000-7f1d97fa5000 rw-p 00000000 00:00 0 7f1d97fa5000-7f1d98000000 ---p 00000000 00:00 0 7f1d98000000-7f1d9bedc000 rw-p 00000000 00:00 0 7f1d9bedc000-7f1d9c000000 ---p 00000000 00:00 0 7f1d9c000000-7f1d9ff03000 rw-p 00000000 00:00 0 7f1d9ff03000-7f1da0000000 ---p 00000000 00:00 0 7f1da0000000-7f1da3f49000 rw-p 00000000 00:00 0 7f1da3f49000-7f1da4000000 ---p 00000000 00:00 0 7f1da4000000-7f1da7fc8000 rw-p 00000000 00:00 0 7f1da7fc8000-7f1da8000000 ---p 00000000 00:00 0 7f1da8000000-7f1dabfd2000 rw-p 00000000 00:00 0 7f1dabfd2000-7f1dac000000 ---p 00000000 00:00 0 7f1dac000000-7f1daff8f000 rw-p 00000000 00:00 0 7f1daff8f000-7f1db0000000 ---p 00000000 00:00 0 7f1db0000000-7f1db3f1f000 rw-p 00000000 00:00 0 7f1db3f1f000-7f1db4000000 ---p 00000000 00:00 0 7f1db4000000-7f1db7fdb000 rw-p 00000000 00:00 0 7f1db7fdb000-7f1db8000000 ---p 00000000 00:00 0 7f1db8000000-7f1dbbec3000 rw-p 00000000 00:00 0 7f1dbbec3000-7f1dbc000000 ---p 00000000 00:00 0 7f1dbc000000-7f1dbff98000 rw-p 00000000 00:00 0 7f1dbff98000-7f1dc0000000 ---p 00000000 00:00 0 7f1dc0000000-7f1dc3fc7000 rw-p 00000000 00:00 0 7f1dc3fc7000-7f1dc4000000 ---p 00000000 00:00 0 7f1dc4000000-7f1dc7fcc000 rw-p 00000000 00:00 0 7f1dc7fcc000-7f1dc8000000 ---p 00000000 00:00 0 7f1dc8000000-7f1dcbf8e000 rw-p 00000000 00:00 0 7f1dcbf8e000-7f1dcc000000 ---p 00000000 00:00 0 7f1dcc000000-7f1dcff9f000 rw-p 00000000 00:00 0 7f1dcff9f000-7f1dd0000000 ---p 00000000 00:00 0 7f1dd0000000-7f1dd3fef000 rw-p 00000000 00:00 0 7f1dd3fef000-7f1dd4000000 ---p 00000000 00:00 0 7f1dd4000000-7f1dd7f80000 rw-p 00000000 00:00 0 7f1dd7f80000-7f1dd8000000 ---p 00000000 00:00 0 7f1dd8000000-7f1ddbfc5000 rw-p 00000000 00:00 0 7f1ddbfc5000-7f1ddc000000 ---p 00000000 00:00 0 7f1ddc000000-7f1ddfdb7000 rw-p 00000000 00:00 0 7f1ddfdb7000-7f1de0000000 ---p 00000000 00:00 0 7f1de0000000-7f1de3fdb000 rw-p 00000000 00:00 0 7f1de3fdb000-7f1de4000000 ---p 00000000 00:00 0 7f1de4000000-7f1de7fd1000 rw-p 00000000 00:00 0 7f1de7fd1000-7f1de8000000 ---p 00000000 00:00 0 7f1de8000000-7f1debfe1000 rw-p 00000000 00:00 0 7f1debfe1000-7f1dec000000 ---p 00000000 00:00 0 7f1dec000000-7f1deffd9000 rw-p 00000000 00:00 0 7f1deffd9000-7f1df0000000 ---p 00000000 00:00 0 7f1df0000000-7f1df3ff1000 rw-p 00000000 00:00 0 7f1df3ff1000-7f1df4000000 ---p 00000000 00:00 0 7f1df4000000-7f1df7f70000 rw-p 00000000 00:00 0 7f1df7f70000-7f1df8000000 ---p 00000000 00:00 0 7f1df8000000-7f1dfbfc1000 rw-p 00000000 00:00 0 7f1dfbfc1000-7f1dfc000000 ---p 00000000 00:00 0 7f1dfc000000-7f1dfffda000 rw-p 00000000 00:00 0 7f1dfffda000-7f1e00000000 ---p 00000000 00:00 0 7f1e00000000-7f1e03fc3000 rw-p 00000000 00:00 0 7f1e03fc3000-7f1e04000000 ---p 00000000 00:00 0 7f1e04000000-7f1e07f9a000 rw-p 00000000 00:00 0 7f1e07f9a000-7f1e08000000 ---p 00000000 00:00 0 7f1e08000000-7f1e0bfe6000 rw-p 00000000 00:00 0 7f1e0bfe6000-7f1e0c000000 ---p 00000000 00:00 0 7f1e0c000000-7f1e0ffd1000 rw-p 00000000 00:00 0 7f1e0ffd1000-7f1e10000000 ---p 00000000 00:00 0 7f1e10000000-7f1e13fa5000 rw-p 00000000 00:00 0 7f1e13fa5000-7f1e14000000 ---p 00000000 00:00 0 7f1e14000000-7f1e17ffa000 rw-p 00000000 00:00 0 7f1e17ffa000-7f1e18000000 ---p 00000000 00:00 0 7f1e18000000-7f1e1bfd1000 rw-p 00000000 00:00 0 7f1e1bfd1000-7f1e1c000000 ---p 00000000 00:00 0 7f1e1c000000-7f1e1fff1000 rw-p 00000000 00:00 0 7f1e1fff1000-7f1e20000000 ---p 00000000 00:00 0 7f1e20000000-7f1e23fc1000 rw-p 00000000 00:00 0 7f1e23fc1000-7f1e24000000 ---p 00000000 00:00 0 7f1e24000000-7f1e27fe2000 rw-p 00000000 00:00 0 7f1e27fe2000-7f1e28000000 ---p 00000000 00:00 0 7f1e28000000-7f1e2bfe1000 rw-p 00000000 00:00 0 7f1e2bfe1000-7f1e2c000000 ---p 00000000 00:00 0 7f1e2c000000-7f1e2fff1000 rw-p 00000000 00:00 0 7f1e2fff1000-7f1e30000000 ---p 00000000 00:00 0 7f1e30000000-7f1e33ff2000 rw-p 00000000 00:00 0 7f1e33ff2000-7f1e34000000 ---p 00000000 00:00 0 7f1e34000000-7f1e37fd2000 rw-p 00000000 00:00 0 7f1e37fd2000-7f1e38000000 ---p 00000000 00:00 0 7f1e38000000-7f1e3bfd2000 rw-p 00000000 00:00 0 7f1e3bfd2000-7f1e3c000000 ---p 00000000 00:00 0 7f1e3c000000-7f1e3ff91000 rw-p 00000000 00:00 0 7f1e3ff91000-7f1e40000000 ---p 00000000 00:00 0 7f1e40000000-7f1e43fc2000 rw-p 00000000 00:00 0 7f1e43fc2000-7f1e44000000 ---p 00000000 00:00 0 7f1e44000000-7f1e47fe2000 rw-p 00000000 00:00 0 7f1e47fe2000-7f1e48000000 ---p 00000000 00:00 0 7f1e48000000-7f1e4bfca000 rw-p 00000000 00:00 0 7f1e4bfca000-7f1e4c000000 ---p 00000000 00:00 0 7f1e4c000000-7f1e4ffe1000 rw-p 00000000 00:00 0 7f1e4ffe1000-7f1e50000000 ---p 00000000 00:00 0 7f1e50000000-7f1e53fd2000 rw-p 00000000 00:00 0 7f1e53fd2000-7f1e54000000 ---p 00000000 00:00 0 7f1e54000000-7f1e57ff2000 rw-p 00000000 00:00 0 7f1e57ff2000-7f1e58000000 ---p 00000000 00:00 0 7f1e58000000-7f1e5bfc1000 rw-p 00000000 00:00 0 7f1e5bfc1000-7f1e5c000000 ---p 00000000 00:00 0 7f1e5c000000-7f1e5ffea000 rw-p 00000000 00:00 0 7f1e5ffea000-7f1e60000000 ---p 00000000 00:00 0 7f1e60000000-7f1e63ffa000 rw-p 00000000 00:00 0 7f1e63ffa000-7f1e64000000 ---p 00000000 00:00 0 7f1e64000000-7f1e67fea000 rw-p 00000000 00:00 0 7f1e67fea000-7f1e68000000 ---p 00000000 00:00 0 7f1e68000000-7f1e6bffa000 rw-p 00000000 00:00 0 7f1e6bffa000-7f1e6c000000 ---p 00000000 00:00 0 7f1e6c000000-7f1e6ffc1000 rw-p 00000000 00:00 0 7f1e6ffc1000-7f1e70000000 ---p 00000000 00:00 0 7f1e70000000-7f1e73fe2000 rw-p 00000000 00:00 0 7f1e73fe2000-7f1e74000000 ---p 00000000 00:00 0 7f1e74000000-7f1e77f49000 rw-p 00000000 00:00 0 7f1e77f49000-7f1e78000000 ---p 00000000 00:00 0 7f1e78000000-7f1e7bfea000 rw-p 00000000 00:00 0 7f1e7bfea000-7f1e7c000000 ---p 00000000 00:00 0 7f1e7c000000-7f1e7fffa000 rw-p 00000000 00:00 0 7f1e7fffa000-7f1e80000000 ---p 00000000 00:00 0 7f1e80000000-7f1e83fc2000 rw-p 00000000 00:00 0 7f1e83fc2000-7f1e84000000 ---p 00000000 00:00 0 7f1e84000000-7f1e87fe2000 rw-p 00000000 00:00 0 7f1e87fe2000-7f1e88000000 ---p 00000000 00:00 0 7f1e88000000-7f1e8bff2000 rw-p 00000000 00:00 0 7f1e8bff2000-7f1e8c000000 ---p 00000000 00:00 0 7f1e8c000000-7f1e8fffa000 rw-p 00000000 00:00 0 7f1e8fffa000-7f1e90000000 ---p 00000000 00:00 0 7f1e90000000-7f1e93ff2000 rw-p 00000000 00:00 0 7f1e93ff2000-7f1e94000000 ---p 00000000 00:00 0 7f1e94000000-7f1e97fe2000 rw-p 00000000 00:00 0 7f1e97fe2000-7f1e98000000 ---p 00000000 00:00 0 7f1e98000000-7f1e9bffa000 rw-p 00000000 00:00 0 7f1e9bffa000-7f1e9c000000 ---p 00000000 00:00 0 7f1e9c000000-7f1e9ff72000 rw-p 00000000 00:00 0 7f1e9ff72000-7f1ea0000000 ---p 00000000 00:00 0 7f1ea0000000-7f1ea3fea000 rw-p 00000000 00:00 0 7f1ea3fea000-7f1ea4000000 ---p 00000000 00:00 0 7f1ea4000000-7f1ea7fda000 rw-p 00000000 00:00 0 7f1ea7fda000-7f1ea8000000 ---p 00000000 00:00 0 7f1ea8000000-7f1eabfd2000 rw-p 00000000 00:00 0 7f1eabfd2000-7f1eac000000 ---p 00000000 00:00 0 7f1eac000000-7f1eaffca000 rw-p 00000000 00:00 0 7f1eaffca000-7f1eb0000000 ---p 00000000 00:00 0 7f1eb0000000-7f1eb3fea000 rw-p 00000000 00:00 0 7f1eb3fea000-7f1eb4000000 ---p 00000000 00:00 0 7f1eb4000000-7f1eb7fea000 rw-p 00000000 00:00 0 7f1eb7fea000-7f1eb8000000 ---p 00000000 00:00 0 7f1eb8000000-7f1ebbf92000 rw-p 00000000 00:00 0 7f1ebbf92000-7f1ebc000000 ---p 00000000 00:00 0 7f1ebc000000-7f1ebffe2000 rw-p 00000000 00:00 0 7f1ebffe2000-7f1ec0000000 ---p 00000000 00:00 0 7f1ec0000000-7f1ec3ffa000 rw-p 00000000 00:00 0 7f1ec3ffa000-7f1ec4000000 ---p 00000000 00:00 0 7f1ec4000000-7f1ec7ff2000 rw-p 00000000 00:00 0 7f1ec7ff2000-7f1ec8000000 ---p 00000000 00:00 0 7f1ec8000000-7f1ecbfea000 rw-p 00000000 00:00 0 7f1ecbfea000-7f1ecc000000 ---p 00000000 00:00 0 7f1ecc000000-7f1ecffa2000 rw-p 00000000 00:00 0 7f1ecffa2000-7f1ed0000000 ---p 00000000 00:00 0 7f1ed0000000-7f1ed3ffa000 rw-p 00000000 00:00 0 7f1ed3ffa000-7f1ed4000000 ---p 00000000 00:00 0 7f1ed4000000-7f1ed7ec2000 rw-p 00000000 00:00 0 7f1ed7ec2000-7f1ed8000000 ---p 00000000 00:00 0 7f1ed8000000-7f1edbfea000 rw-p 00000000 00:00 0 7f1edbfea000-7f1edc000000 ---p 00000000 00:00 0 7f1edc000000-7f1edffca000 rw-p 00000000 00:00 0 7f1edffca000-7f1ee0000000 ---p 00000000 00:00 0 7f1ee0000000-7f1ee3fd2000 rw-p 00000000 00:00 0 7f1ee3fd2000-7f1ee4000000 ---p 00000000 00:00 0 7f1ee4000000-7f1ee7fea000 rw-p 00000000 00:00 0 7f1ee7fea000-7f1ee8000000 ---p 00000000 00:00 0 7f1ee8000000-7f1eebffa000 rw-p 00000000 00:00 0 7f1eebffa000-7f1eec000000 ---p 00000000 00:00 0 7f1eec000000-7f1eeffe2000 rw-p 00000000 00:00 0 7f1eeffe2000-7f1ef0000000 ---p 00000000 00:00 0 7f1ef0000000-7f1ef3ff2000 rw-p 00000000 00:00 0 7f1ef3ff2000-7f1ef4000000 ---p 00000000 00:00 0 7f1ef4000000-7f1ef7fd2000 rw-p 00000000 00:00 0 7f1ef7fd2000-7f1ef8000000 ---p 00000000 00:00 0 7f1ef8000000-7f1efbff2000 rw-p 00000000 00:00 0 7f1efbff2000-7f1efc000000 ---p 00000000 00:00 0 7f1efc000000-7f1efffda000 rw-p 00000000 00:00 0 7f1efffda000-7f1f00000000 ---p 00000000 00:00 0 7f1f00000000-7f1f03fe2000 rw-p 00000000 00:00 0 7f1f03fe2000-7f1f04000000 ---p 00000000 00:00 0 7f1f04000000-7f1f07ffa000 rw-p 00000000 00:00 0 7f1f07ffa000-7f1f08000000 ---p 00000000 00:00 0 7f1f08000000-7f1f0bfea000 rw-p 00000000 00:00 0 7f1f0bfea000-7f1f0c000000 ---p 00000000 00:00 0 7f1f0c000000-7f1f0ffd2000 rw-p 00000000 00:00 0 7f1f0ffd2000-7f1f10000000 ---p 00000000 00:00 0 7f1f10000000-7f1f13fc2000 rw-p 00000000 00:00 0 7f1f13fc2000-7f1f14000000 ---p 00000000 00:00 0 7f1f14000000-7f1f17fe2000 rw-p 00000000 00:00 0 7f1f17fe2000-7f1f18000000 ---p 00000000 00:00 0 7f1f18000000-7f1f1bfda000 rw-p 00000000 00:00 0 7f1f1bfda000-7f1f1c000000 ---p 00000000 00:00 0 7f1f1c000000-7f1f1ffe2000 rw-p 00000000 00:00 0 7f1f1ffe2000-7f1f20000000 ---p 00000000 00:00 0 7f1f20000000-7f1f23ff2000 rw-p 00000000 00:00 0 7f1f23ff2000-7f1f24000000 ---p 00000000 00:00 0 7f1f24000000-7f1f27fc2000 rw-p 00000000 00:00 0 7f1f27fc2000-7f1f28000000 ---p 00000000 00:00 0 7f1f28000000-7f1f2bff2000 rw-p 00000000 00:00 0 7f1f2bff2000-7f1f2c000000 ---p 00000000 00:00 0 7f1f2c000000-7f1f2fffa000 rw-p 00000000 00:00 0 7f1f2fffa000-7f1f30000000 ---p 00000000 00:00 0 7f1f30000000-7f1f33fd2000 rw-p 00000000 00:00 0 7f1f33fd2000-7f1f34000000 ---p 00000000 00:00 0 7f1f34000000-7f1f37fe6000 rw-p 00000000 00:00 0 7f1f37fe6000-7f1f38000000 ---p 00000000 00:00 0 7f1f38000000-7f1f3bfe2000 rw-p 00000000 00:00 0 7f1f3bfe2000-7f1f3c000000 ---p 00000000 00:00 0 7f1f3c000000-7f1f3fffa000 rw-p 00000000 00:00 0 7f1f3fffa000-7f1f40000000 ---p 00000000 00:00 0 7f1f40000000-7f1f43ff2000 rw-p 00000000 00:00 0 7f1f43ff2000-7f1f44000000 ---p 00000000 00:00 0 7f1f44000000-7f1f47fca000 rw-p 00000000 00:00 0 7f1f47fca000-7f1f48000000 ---p 00000000 00:00 0 7f1f48000000-7f1f4bffa000 rw-p 00000000 00:00 0 7f1f4bffa000-7f1f4c000000 ---p 00000000 00:00 0 7f1f4c000000-7f1f4fffa000 rw-p 00000000 00:00 0 7f1f4fffa000-7f1f50000000 ---p 00000000 00:00 0 7f1f50000000-7f1f53f13000 rw-p 00000000 00:00 0 7f1f53f13000-7f1f54000000 ---p 00000000 00:00 0 7f1f54000000-7f1f57fce000 rw-p 00000000 00:00 0 7f1f57fce000-7f1f58000000 ---p 00000000 00:00 0 7f1f58000000-7f1f5bfe6000 rw-p 00000000 00:00 0 7f1f5bfe6000-7f1f5c000000 ---p 00000000 00:00 0 7f1f5c000000-7f1f5fff2000 rw-p 00000000 00:00 0 7f1f5fff2000-7f1f60000000 ---p 00000000 00:00 0 7f1f60000000-7f1f63fda000 rw-p 00000000 00:00 0 7f1f63fda000-7f1f64000000 ---p 00000000 00:00 0 7f1f64000000-7f1f67fea000 rw-p 00000000 00:00 0 7f1f67fea000-7f1f68000000 ---p 00000000 00:00 0 7f1f68000000-7f1f6bffa000 rw-p 00000000 00:00 0 7f1f6bffa000-7f1f6c000000 ---p 00000000 00:00 0 7f1f6c000000-7f1f6fff2000 rw-p 00000000 00:00 0 7f1f6fff2000-7f1f70000000 ---p 00000000 00:00 0 7f1f70000000-7f1f73ffa000 rw-p 00000000 00:00 0 7f1f73ffa000-7f1f74000000 ---p 00000000 00:00 0 7f1f74000000-7f1f77fe2000 rw-p 00000000 00:00 0 7f1f77fe2000-7f1f78000000 ---p 00000000 00:00 0 7f1f78000000-7f1f7bff2000 rw-p 00000000 00:00 0 7f1f7bff2000-7f1f7c000000 ---p 00000000 00:00 0 7f1f7c000000-7f1f7ff82000 rw-p 00000000 00:00 0 7f1f7ff82000-7f1f80000000 ---p 00000000 00:00 0 7f1f80000000-7f1f83fd3000 rw-p 00000000 00:00 0 7f1f83fd3000-7f1f84000000 ---p 00000000 00:00 0 7f1f84000000-7f1f87f52000 rw-p 00000000 00:00 0 7f1f87f52000-7f1f88000000 ---p 00000000 00:00 0 7f1f88000000-7f1f8bffa000 rw-p 00000000 00:00 0 7f1f8bffa000-7f1f8c000000 ---p 00000000 00:00 0 7f1f8c000000-7f1f8ffeb000 rw-p 00000000 00:00 0 7f1f8ffeb000-7f1f90000000 ---p 00000000 00:00 0 7f1f90000000-7f1f93ff3000 rw-p 00000000 00:00 0 7f1f93ff3000-7f1f94000000 ---p 00000000 00:00 0 7f1f94000000-7f1f97fdb000 rw-p 00000000 00:00 0 7f1f97fdb000-7f1f98000000 ---p 00000000 00:00 0 7f1f98000000-7f1f9bf02000 rw-p 00000000 00:00 0 7f1f9bf02000-7f1f9c000000 ---p 00000000 00:00 0 7f1f9c000000-7f1f9ffe6000 rw-p 00000000 00:00 0 7f1f9ffe6000-7f1fa0000000 ---p 00000000 00:00 0 7f1fa0000000-7f1fa3ff6000 rw-p 00000000 00:00 0 7f1fa3ff6000-7f1fa4000000 ---p 00000000 00:00 0 7f1fa4000000-7f1fa7ff3000 rw-p 00000000 00:00 0 7f1fa7ff3000-7f1fa8000000 ---p 00000000 00:00 0 7f1fa8000000-7f1fabffe000 rw-p 00000000 00:00 0 7f1fabffe000-7f1fac000000 ---p 00000000 00:00 0 7f1fac000000-7f1fafff7000 rw-p 00000000 00:00 0 7f1fafff7000-7f1fb0000000 ---p 00000000 00:00 0 7f1fb0000000-7f1fb3f8f000 rw-p 00000000 00:00 0 7f1fb3f8f000-7f1fb4000000 ---p 00000000 00:00 0 7f1fb4000000-7f1fb7fbb000 rw-p 00000000 00:00 0 7f1fb7fbb000-7f1fb8000000 ---p 00000000 00:00 0 7f1fb8000000-7f1fbbff7000 rw-p 00000000 00:00 0 7f1fbbff7000-7f1fbc000000 ---p 00000000 00:00 0 7f1fbc000000-7f1fbfff7000 rw-p 00000000 00:00 0 7f1fbfff7000-7f1fc0000000 ---p 00000000 00:00 0 7f1fc0000000-7f1fc3fe3000 rw-p 00000000 00:00 0 7f1fc3fe3000-7f1fc4000000 ---p 00000000 00:00 0 7f1fc4000000-7f1fc7ff7000 rw-p 00000000 00:00 0 7f1fc7ff7000-7f1fc8000000 ---p 00000000 00:00 0 7f1fc8000000-7f1fcbfcf000 rw-p 00000000 00:00 0 7f1fcbfcf000-7f1fcc000000 ---p 00000000 00:00 0 7f1fcc000000-7f1fcfff7000 rw-p 00000000 00:00 0 7f1fcfff7000-7f1fd0000000 ---p 00000000 00:00 0 7f1fd0000000-7f1fd3fe7000 rw-p 00000000 00:00 0 7f1fd3fe7000-7f1fd4000000 ---p 00000000 00:00 0 7f1fd4000000-7f1fd7fef000 rw-p 00000000 00:00 0 7f1fd7fef000-7f1fd8000000 ---p 00000000 00:00 0 7f1fd8000000-7f1fdbffb000 rw-p 00000000 00:00 0 7f1fdbffb000-7f1fdc000000 ---p 00000000 00:00 0 7f1fdc000000-7f1fdffe3000 rw-p 00000000 00:00 0 7f1fdffe3000-7f1fe0000000 ---p 00000000 00:00 0 7f1fe0000000-7f1fe3ff7000 rw-p 00000000 00:00 0 7f1fe3ff7000-7f1fe4000000 ---p 00000000 00:00 0 7f1fe4000000-7f1fe7ffb000 rw-p 00000000 00:00 0 7f1fe7ffb000-7f1fe8000000 ---p 00000000 00:00 0 7f1fe8000000-7f1febfff000 rw-p 00000000 00:00 0 7f1febfff000-7f1fec000000 ---p 00000000 00:00 0 7f1fec000000-7f1ff0000000 rw-p 00000000 00:00 0 7f1ff0000000-7f1ff3ff7000 rw-p 00000000 00:00 0 7f1ff3ff7000-7f1ff4000000 ---p 00000000 00:00 0 7f1ff4000000-7f1ff7fff000 rw-p 00000000 00:00 0 7f1ff7fff000-7f1ff8000000 ---p 00000000 00:00 0 7f1ff8000000-7f1ffbff4000 rw-p 00000000 00:00 0 7f1ffbff4000-7f1ffc000000 ---p 00000000 00:00 0 7f1ffc000000-7f2000000000 rw-p 00000000 00:00 0 7f2000000000-7f2003ff8000 rw-p 00000000 00:00 0 7f2003ff8000-7f2004000000 ---p 00000000 00:00 0 7f2004000000-7f2007ffb000 rw-p 00000000 00:00 0 7f2007ffb000-7f2008000000 ---p 00000000 00:00 0 7f2008000000-7f200bffc000 rw-p 00000000 00:00 0 7f200bffc000-7f200c000000 ---p 00000000 00:00 0 7f200c000000-7f200fff4000 rw-p 00000000 00:00 0 7f200fff4000-7f2010000000 ---p 00000000 00:00 0 7f2010000000-7f2013ffc000 rw-p 00000000 00:00 0 7f2013ffc000-7f2014000000 ---p 00000000 00:00 0 7f2014000000-7f2017ff3000 rw-p 00000000 00:00 0 7f2017ff3000-7f2018000000 ---p 00000000 00:00 0 7f2018000000-7f201bff8000 rw-p 00000000 00:00 0 7f201bff8000-7f201c000000 ---p 00000000 00:00 0 7f201c000000-7f201fffb000 rw-p 00000000 00:00 0 7f201fffb000-7f2020000000 ---p 00000000 00:00 0 7f2020000000-7f2023fe4000 rw-p 00000000 00:00 0 7f2023fe4000-7f2024000000 ---p 00000000 00:00 0 7f2024000000-7f2027ffc000 rw-p 00000000 00:00 0 7f2027ffc000-7f2028000000 ---p 00000000 00:00 0 7f2028000000-7f202c000000 rw-p 00000000 00:00 0 7f202c000000-7f202fffb000 rw-p 00000000 00:00 0 7f202fffb000-7f2030000000 ---p 00000000 00:00 0 7f2030000000-7f2034000000 rw-p 00000000 00:00 0 7f2034000000-7f2037ffa000 rw-p 00000000 00:00 0 7f2037ffa000-7f2038000000 ---p 00000000 00:00 0 7f2038000000-7f203bffc000 rw-p 00000000 00:00 0 7f203bffc000-7f203c000000 ---p 00000000 00:00 0 7f203c000000-7f203fffe000 rw-p 00000000 00:00 0 7f203fffe000-7f2040000000 ---p 00000000 00:00 0 7f2040000000-7f2043ffa000 rw-p 00000000 00:00 0 7f2043ffa000-7f2044000000 ---p 00000000 00:00 0 7f2044000000-7f2047ffe000 rw-p 00000000 00:00 0 7f2047ffe000-7f2048000000 ---p 00000000 00:00 0 7f2048000000-7f204bfff000 rw-p 00000000 00:00 0 7f204bfff000-7f204c000000 ---p 00000000 00:00 0 7f204c000000-7f2050000000 rw-p 00000000 00:00 0 7f2050000000-7f2053ff5000 rw-p 00000000 00:00 0 7f2053ff5000-7f2054000000 ---p 00000000 00:00 0 7f2054000000-7f2057fea000 rw-p 00000000 00:00 0 7f2057fea000-7f2058000000 ---p 00000000 00:00 0 7f2058000000-7f205bff2000 rw-p 00000000 00:00 0 7f205bff2000-7f205c000000 ---p 00000000 00:00 0 7f205c000000-7f205fff7000 rw-p 00000000 00:00 0 7f205fff7000-7f2060000000 ---p 00000000 00:00 0 7f2060000000-7f2063fff000 rw-p 00000000 00:00 0 7f2063fff000-7f2064000000 ---p 00000000 00:00 0 7f2064000000-7f2067ffc000 rw-p 00000000 00:00 0 7f2067ffc000-7f2068000000 ---p 00000000 00:00 0 7f2068000000-7f206bf9a000 rw-p 00000000 00:00 0 7f206bf9a000-7f206c000000 ---p 00000000 00:00 0 7f206c000000-7f206fff5000 rw-p 00000000 00:00 0 7f206fff5000-7f2070000000 ---p 00000000 00:00 0 7f2070000000-7f2073fd5000 rw-p 00000000 00:00 0 7f2073fd5000-7f2074000000 ---p 00000000 00:00 0 7f2074000000-7f2077fdf000 rw-p 00000000 00:00 0 7f2077fdf000-7f2078000000 ---p 00000000 00:00 0 7f2078000000-7f207c000000 rw-p 00000000 00:00 0 7f207c000000-7f207fff9000 rw-p 00000000 00:00 0 7f207fff9000-7f2080000000 ---p 00000000 00:00 0 7f2080000000-7f2083ff5000 rw-p 00000000 00:00 0 7f2083ff5000-7f2084000000 ---p 00000000 00:00 0 7f2084000000-7f2087ffc000 rw-p 00000000 00:00 0 7f2087ffc000-7f2088000000 ---p 00000000 00:00 0 7f2088000000-7f208bff7000 rw-p 00000000 00:00 0 7f208bff7000-7f208c000000 ---p 00000000 00:00 0 7f208c000000-7f208fff6000 rw-p 00000000 00:00 0 7f208fff6000-7f2090000000 ---p 00000000 00:00 0 7f2090000000-7f2093ffe000 rw-p 00000000 00:00 0 7f2093ffe000-7f2094000000 ---p 00000000 00:00 0 7f2094000000-7f2098000000 rw-p 00000000 00:00 0 7f2098000000-7f209bff9000 rw-p 00000000 00:00 0 7f209bff9000-7f209c000000 ---p 00000000 00:00 0 7f209c000000-7f209fffb000 rw-p 00000000 00:00 0 7f209fffb000-7f20a0000000 ---p 00000000 00:00 0 7f20a0000000-7f20a3ffb000 rw-p 00000000 00:00 0 7f20a3ffb000-7f20a4000000 ---p 00000000 00:00 0 7f20a4000000-7f20a7ff2000 rw-p 00000000 00:00 0 7f20a7ff2000-7f20a8000000 ---p 00000000 00:00 0 7f20a8000000-7f20abffa000 rw-p 00000000 00:00 0 7f20abffa000-7f20ac000000 ---p 00000000 00:00 0 7f20ac000000-7f20b0000000 rw-p 00000000 00:00 0 7f20b0000000-7f20b3ff9000 rw-p 00000000 00:00 0 7f20b3ff9000-7f20b4000000 ---p 00000000 00:00 0 7f20b4000000-7f20b7ffc000 rw-p 00000000 00:00 0 7f20b7ffc000-7f20b8000000 ---p 00000000 00:00 0 7f20b8000000-7f20bbffa000 rw-p 00000000 00:00 0 7f20bbffa000-7f20bc000000 ---p 00000000 00:00 0 7f20bc000000-7f20bfff9000 rw-p 00000000 00:00 0 7f20bfff9000-7f20c0000000 ---p 00000000 00:00 0 7f20c0000000-7f20c4000000 rw-p 00000000 00:00 0 7f20c4000000-7f20c7ffe000 rw-p 00000000 00:00 0 7f20c7ffe000-7f20c8000000 ---p 00000000 00:00 0 7f20c8000000-7f20cbfff000 rw-p 00000000 00:00 0 7f20cbfff000-7f20cc000000 ---p 00000000 00:00 0 7f20cc000000-7f20cffff000 rw-p 00000000 00:00 0 7f20cffff000-7f20d0000000 ---p 00000000 00:00 0 7f20d0000000-7f20d3fe1000 rw-p 00000000 00:00 0 7f20d3fe1000-7f20d4000000 ---p 00000000 00:00 0 7f20d4000000-7f20d7fff000 rw-p 00000000 00:00 0 7f20d7fff000-7f20d8000000 ---p 00000000 00:00 0 7f20e0000000-7f20e0021000 rw-p 00000000 00:00 0 7f20e0021000-7f20e4000000 ---p 00000000 00:00 0 7f20e8000000-7f20ebfff000 rw-p 00000000 00:00 0 7f20ebfff000-7f20ec000000 ---p 00000000 00:00 0 7f20ec000000-7f20effff000 rw-p 00000000 00:00 0 7f20effff000-7f20f0000000 ---p 00000000 00:00 0 7f20f0000000-7f20f3ffd000 rw-p 00000000 00:00 0 7f20f3ffd000-7f20f4000000 ---p 00000000 00:00 0 7f20f4000000-7f20f8000000 rw-p 00000000 00:00 0 7f20f8000000-7f20fbc1b000 rw-p 00000000 00:00 0 7f20fbc1b000-7f20fc000000 ---p 00000000 00:00 0 7f20fc000000-7f20ffffd000 rw-p 00000000 00:00 0 7f20ffffd000-7f2100000000 ---p 00000000 00:00 0 7f2100000000-7f2103ff4000 rw-p 00000000 00:00 0 7f2103ff4000-7f2104000000 ---p 00000000 00:00 0 7f2108000000-7f210bff2000 rw-p 00000000 00:00 0 7f210bff2000-7f210c000000 ---p 00000000 00:00 0 7f2110000000-7f2114000000 rw-p 00000000 00:00 0 7f2114e33000-7f2118000000 rw-p 00000000 00:00 0 7f2118000000-7f211bffe000 rw-p 00000000 00:00 0 7f211bffe000-7f211c000000 ---p 00000000 00:00 0 7f211c000000-7f2120000000 rw-p 00000000 00:00 0 7f2120000000-7f2123ff3000 rw-p 00000000 00:00 0 7f2123ff3000-7f2124000000 ---p 00000000 00:00 0 7f2124adc000-7f2126ca0000 rw-p 00000000 00:00 0 7f2126ca0000-7f2126ca1000 ---p 00000000 00:00 0 7f2126ca1000-7f21274a1000 rwxp 00000000 00:00 0 7f21274a1000-7f21274a2000 ---p 00000000 00:00 0 7f21274a2000-7f2127ca2000 rwxp 00000000 00:00 0 [stack:36231] 7f2127ca2000-7f2127ca3000 ---p 00000000 00:00 0 7f2127ca3000-7f21284a3000 rwxp 00000000 00:00 0 [stack:36230] 7f21284a3000-7f21284a4000 ---p 00000000 00:00 0 7f21284a4000-7f2128ca4000 rwxp 00000000 00:00 0 [stack:36229] 7f2128ca4000-7f2128ca5000 ---p 00000000 00:00 0 7f2128ca5000-7f21294a5000 rwxp 00000000 00:00 0 [stack:36225] 7f2129ca4000-7f2129ca5000 ---p 00000000 00:00 0 7f2129ca5000-7f212a4a5000 rwxp 00000000 00:00 0 [stack:36228] 7f212a4a5000-7f212a4a6000 ---p 00000000 00:00 0 7f212a4a6000-7f212aca6000 rwxp 00000000 00:00 0 [stack:36227] 7f212aca6000-7f212aca7000 ---p 00000000 00:00 0 7f212aca7000-7f212b4a7000 rwxp 00000000 00:00 0 [stack:36226] 7f212b4a7000-7f212b4ae000 r-xp 00000000 08:01 528993 /usr/lib64/librt-2.17.so 7f212b4ae000-7f212b6ad000 ---p 00007000 08:01 528993 /usr/lib64/librt-2.17.so 7f212b6ad000-7f212b6ae000 r--p 00006000 08:01 528993 /usr/lib64/librt-2.17.so 7f212b6ae000-7f212b6af000 rw-p 00007000 08:01 528993 /usr/lib64/librt-2.17.so 7f212b6af000-7f212b6b2000 r-xp 00000000 08:01 528969 /usr/lib64/libdl-2.17.so 7f212b6b2000-7f212b8b1000 ---p 00003000 08:01 528969 /usr/lib64/libdl-2.17.so 7f212b8b1000-7f212b8b2000 r--p 00002000 08:01 528969 /usr/lib64/libdl-2.17.so 7f212b8b2000-7f212b8b3000 rw-p 00003000 08:01 528969 /usr/lib64/libdl-2.17.so 7f212b8b3000-7f212ba6a000 r-xp 00000000 08:01 528963 /usr/lib64/libc-2.17.so 7f212ba6a000-7f212bc6a000 ---p 001b7000 08:01 528963 /usr/lib64/libc-2.17.so 7f212bc6a000-7f212bc6e000 r--p 001b7000 08:01 528963 /usr/lib64/libc-2.17.so 7f212bc6e000-7f212bc70000 rw-p 001bb000 08:01 528963 /usr/lib64/libc-2.17.so 7f212bc70000-7f212bc75000 rw-p 00000000 00:00 0 7f212bc75000-7f212bc8b000 r-xp 00000000 08:01 528989 /usr/lib64/libpthread-2.17.so 7f212bc8b000-7f212be8b000 ---p 00016000 08:01 528989 /usr/lib64/libpthread-2.17.so 7f212be8b000-7f212be8c000 r--p 00016000 08:01 528989 /usr/lib64/libpthread-2.17.so 7f212be8c000-7f212be8d000 rw-p 00017000 08:01 528989 /usr/lib64/libpthread-2.17.so 7f212be8d000-7f212be91000 rw-p 00000000 00:00 0 7f212be91000-7f212bea6000 r-xp 00000000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7f212bea6000-7f212c0a5000 ---p 00015000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7f212c0a5000-7f212c0a6000 r--p 00014000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7f212c0a6000-7f212c0a7000 rw-p 00015000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7f212c0a7000-7f212c0bd000 r-xp 00000000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7f212c0bd000-7f212c2bc000 ---p 00016000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7f212c2bc000-7f212c2bd000 r--p 00015000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7f212c2bd000-7f212c2be000 rw-p 00016000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7f212c2be000-7f212c3bf000 r-xp 00000000 08:01 528971 /usr/lib64/libm-2.17.so 7f212c3bf000-7f212c5be000 ---p 00101000 08:01 528971 /usr/lib64/libm-2.17.so 7f212c5be000-7f212c5bf000 r--p 00100000 08:01 528971 /usr/lib64/libm-2.17.so 7f212c5bf000-7f212c5c0000 rw-p 00101000 08:01 528971 /usr/lib64/libm-2.17.so 7f212c5c0000-7f212c6a9000 r-xp 00000000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7f212c6a9000-7f212c8a9000 ---p 000e9000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7f212c8a9000-7f212c8b1000 r--p 000e9000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7f212c8b1000-7f212c8b3000 rw-p 000f1000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7f212c8b3000-7f212c8c8000 rw-p 00000000 00:00 0 7f212c8c8000-7f212c8cb000 r-xp 00000000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7f212c8cb000-7f212caca000 ---p 00003000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7f212caca000-7f212cacb000 r--p 00002000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7f212cacb000-7f212cacc000 rw-p 00003000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7f212cacc000-7f212cae3000 r-xp 00000000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7f212cae3000-7f212cce3000 ---p 00017000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7f212cce3000-7f212cce4000 r--p 00017000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7f212cce4000-7f212cce5000 rw-p 00018000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7f212cce5000-7f212ccea000 r-xp 00000000 08:01 690432 /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1.0.0 7f212ccea000-7f212ceea000 ---p 00005000 08:01 690432 /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1.0.0 7f212ceea000-7f212ceeb000 rw-p 00005000 08:01 690432 /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1.0.0 7f212ceeb000-7f212cf0c000 r-xp 00000000 08:01 558686 /usr/lib64/ld-2.17.so 7f212d0d6000-7f212d0de000 rw-p 00000000 00:00 0 7f212d108000-7f212d10c000 rw-p 00000000 00:00 0 7f212d10c000-7f212d10d000 r--p 00021000 08:01 558686 /usr/lib64/ld-2.17.so 7f212d10d000-7f212d10e000 rw-p 00022000 08:01 558686 /usr/lib64/ld-2.17.so 7f212d10e000-7f212d10f000 rw-p 00000000 00:00 0 7ffe38de6000-7ffe38e07000 rwxp 00000000 00:00 0 [stack] 7ffe38e07000-7ffe38e08000 rw-p 00000000 00:00 0 7ffe38e17000-7ffe38e19000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] Aborted (core dumped)

Training with GPU

Set the additional parameters:

device = gpu gpu_platform_id = 0 gpu_device_id = 0

The training task failed with the error message:

[LightGBM] [Info] Finished loading parameters [LightGBM] [Info] Finished loading data in 66.293307 seconds [LightGBM] [Info] Number of positive: 100694, number of negative: 99742 [LightGBM] [Info] This is the GPU trainer!! [LightGBM] [Info] Total Bins 51742 [LightGBM] [Info] Number of data: 200436, number of used features: 25871 [LightGBM] [Info] Using requested OpenCL platform 0 device 0 [LightGBM] [Info] Using GPU Device: Tesla K80, Vendor: NVIDIA Corporation [LightGBM] [Info] Compiling OpenCL Kernel with 16 bins... [LightGBM] [Info] GPU programs have been built [LightGBM] [Info] Size of histogram bin entry: 12 [LightGBM] [Info] 15 dense feature groups (1.53 MB) transfered to GPU in 0.017528 secs. 25856 sparse feature groups. Error in `./lightgbm': double free or corruption (out): 0x00000002ad0ba630 ======= Backtrace: ========= /lib64/libc.so.6(+0x7d053)[0x7fc96b15a053] ./lightgbm(_ZN8LightGBM4GBDT17ResetTrainingDataEPKNS_14BoostingConfigEPKNS_7DatasetEPKNS_17ObjectiveFunctionERKSt6vectorIPKNS_6MetricESaISD_EE+0x1248)[0x45bb58] ./lightgbm(_ZN8LightGBM11Application9InitTrainEv+0x22c)[0x44260c] ./lightgbm(main+0x2a)[0x43e79a] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7fc96b0feb15] ./lightgbm[0x43f06d] ======= Memory map: ======== 00400000-00552000 r-xp 00000000 08:11 12585186 /disk1/lib/LightGBM/lightgbm 00752000-00757000 r--p 00152000 08:11 12585186 /disk1/lib/LightGBM/lightgbm 00757000-00758000 rw-p 00157000 08:11 12585186 /disk1/lib/LightGBM/lightgbm 01c2b000-32fc1a000 rw-p 00000000 00:00 0 [heap] 400000000-400100000 rw-s 1f8fa7b000 00:05 60806 /dev/nvidiactl 400100000-400104000 rw-s 1a737ec000 00:05 60806 /dev/nvidiactl 400104000-400120000 ---p 00000000 00:00 0 400120000-400520000 rw-s 1aa2004000 00:05 60806 /dev/nvidiactl 400520000-400524000 rw-s 1d0c4c3000 00:05 60806 /dev/nvidiactl 400524000-400540000 ---p 00000000 00:00 0 400540000-400940000 rw-s 1d0c4c7000 00:05 60806 /dev/nvidiactl 400940000-400944000 rw-s 1d0b49e000 00:05 60806 /dev/nvidiactl 400944000-400960000 ---p 00000000 00:00 0 400960000-400d60000 rw-s 1f65d1a000 00:05 60806 /dev/nvidiactl 400d60000-400d64000 rw-s 1f2d811000 00:05 60806 /dev/nvidiactl 400d64000-400d80000 ---p 00000000 00:00 0 400d80000-401180000 rw-s 1f2d816000 00:05 60806 /dev/nvidiactl 401180000-401184000 rw-s 1a73678000 00:05 60806 /dev/nvidiactl 401184000-4011a0000 ---p 00000000 00:00 0 4011a0000-4015a0000 rw-s 1c5bcc4000 00:05 60806 /dev/nvidiactl 4015a0000-4015a4000 rw-s 1f90513000 00:05 60806 /dev/nvidiactl 4015a4000-4015c0000 ---p 00000000 00:00 0 4015c0000-4019c0000 rw-s 1f266c3000 00:05 60806 /dev/nvidiactl 4019c0000-4019c4000 rw-s 1f8bdfe000 00:05 60806 /dev/nvidiactl 4019c4000-4019e0000 ---p 00000000 00:00 0 4019e0000-401de0000 rw-s 1f8ac4a000 00:05 60806 /dev/nvidiactl 401de0000-401de4000 rw-s 1f033dd000 00:05 60806 /dev/nvidiactl 401de4000-401e00000 ---p 00000000 00:00 0 401e00000-402200000 rw-s 1c44629000 00:05 60806 /dev/nvidiactl 402200000-402204000 rw-s 1c44095000 00:05 60806 /dev/nvidiactl 402204000-402220000 ---p 00000000 00:00 0 402220000-402620000 rw-s 1c440b2000 00:05 60806 /dev/nvidiactl 402620000-402624000 rw-s 1ef4561000 00:05 60806 /dev/nvidiactl 402624000-402640000 ---p 00000000 00:00 0 402640000-402a40000 rw-s 1ef456d000 00:05 60806 /dev/nvidiactl 402a40000-402a44000 rw-s 1c542ec000 00:05 60806 /dev/nvidiactl 402a44000-402a60000 ---p 00000000 00:00 0 402a60000-402e60000 rw-s 1ee1cf4000 00:05 60806 /dev/nvidiactl 402e60000-402e64000 rw-s 1f8e167000 00:05 60806 /dev/nvidiactl 402e64000-402e80000 ---p 00000000 00:00 0 402e80000-403280000 rw-s 1f8e1e3000 00:05 60806 /dev/nvidiactl 403280000-403284000 rw-s 1f003d5000 00:05 60806 /dev/nvidiactl 403284000-4032a0000 ---p 00000000 00:00 0 4032a0000-4036a0000 rw-s 1ef648d000 00:05 60806 /dev/nvidiactl 4036a0000-4036a4000 rw-s 1ef5bd0000 00:05 60806 /dev/nvidiactl 4036a4000-4036c0000 ---p 00000000 00:00 0 4036c0000-403ac0000 rw-s 1ef5bdc000 00:05 60806 /dev/nvidiactl 403ac0000-403ac4000 rw-s 1ef50bb000 00:05 60806 /dev/nvidiactl 403ac4000-403ae0000 ---p 00000000 00:00 0 403ae0000-403ee0000 rw-s 1f65f63000 00:05 60806 /dev/nvidiactl 403ee0000-403ee4000 rw-s 1f83956000 00:05 60806 /dev/nvidiactl 403ee4000-403f00000 ---p 00000000 00:00 0 403f00000-404300000 rw-s 1f00152000 00:05 60806 /dev/nvidiactl 404300000-404400000 rw-s 1f3f083000 00:05 60806 /dev/nvidiactl 404400000-404500000 rw-s 1fbfb79000 00:05 60806 /dev/nvidiactl 404500000-404600000 rw-s 1f9226c000 00:05 60806 /dev/nvidiactl 404600000-404700000 rw-s 1f2f97e000 00:05 60806 /dev/nvidiactl 404700000-404800000 rw-s 2a32902000 00:05 60806 /dev/nvidiactl 404800000-404882000 rw-s 27d87b7000 00:05 60806 /dev/nvidiactl 404882000-5100000000 ---p 00000000 00:00 0 7fc52c000000-7fc52ff17000 rw-p 00000000 00:00 0 7fc52ff17000-7fc530000000 ---p 00000000 00:00 0 7fc530000000-7fc533ec5000 rw-p 00000000 00:00 0 7fc533ec5000-7fc534000000 ---p 00000000 00:00 0 7fc534000000-7fc537fdb000 rw-p 00000000 00:00 0 7fc537fdb000-7fc538000000 ---p 00000000 00:00 0 7fc538000000-7fc53bfe6000 rw-p 00000000 00:00 0 7fc53bfe6000-7fc53c000000 ---p 00000000 00:00 0 7fc53c000000-7fc53ff7b000 rw-p 00000000 00:00 0 7fc53ff7b000-7fc540000000 ---p 00000000 00:00 0 7fc540000000-7fc543fca000 rw-p 00000000 00:00 0 7fc543fca000-7fc544000000 ---p 00000000 00:00 0 7fc544000000-7fc547f6f000 rw-p 00000000 00:00 0 7fc547f6f000-7fc548000000 ---p 00000000 00:00 0 7fc548000000-7fc54bf1c000 rw-p 00000000 00:00 0 7fc54bf1c000-7fc54c000000 ---p 00000000 00:00 0 7fc54c000000-7fc54ff36000 rw-p 00000000 00:00 0 7fc54ff36000-7fc550000000 ---p 00000000 00:00 0 7fc550000000-7fc553fd8000 rw-p 00000000 00:00 0 7fc553fd8000-7fc554000000 ---p 00000000 00:00 0 7fc554000000-7fc557f7f000 rw-p 00000000 00:00 0 7fc557f7f000-7fc558000000 ---p 00000000 00:00 0 7fc558000000-7fc55bf6c000 rw-p 00000000 00:00 0 7fc55bf6c000-7fc55c000000 ---p 00000000 00:00 0 7fc55c000000-7fc55ff03000 rw-p 00000000 00:00 0 7fc55ff03000-7fc560000000 ---p 00000000 00:00 0 7fc560000000-7fc563f55000 rw-p 00000000 00:00 0 7fc563f55000-7fc564000000 ---p 00000000 00:00 0 7fc564000000-7fc567f74000 rw-p 00000000 00:00 0 7fc567f74000-7fc568000000 ---p 00000000 00:00 0 7fc568000000-7fc56bf86000 rw-p 00000000 00:00 0 7fc56bf86000-7fc56c000000 ---p 00000000 00:00 0 7fc56c000000-7fc56ff80000 rw-p 00000000 00:00 0 7fc56ff80000-7fc570000000 ---p 00000000 00:00 0 7fc570000000-7fc57270d000 rw-p 00000000 00:00 0 7fc57270d000-7fc574000000 ---p 00000000 00:00 0 7fc574000000-7fc577fa8000 rw-p 00000000 00:00 0 7fc577fa8000-7fc578000000 ---p 00000000 00:00 0 7fc578000000-7fc57bf5d000 rw-p 00000000 00:00 0 7fc57bf5d000-7fc57c000000 ---p 00000000 00:00 0 7fc57c000000-7fc57ffb6000 rw-p 00000000 00:00 0 7fc57ffb6000-7fc580000000 ---p 00000000 00:00 0 7fc580000000-7fc583ee5000 rw-p 00000000 00:00 0 7fc583ee5000-7fc584000000 ---p 00000000 00:00 0 7fc584000000-7fc587faa000 rw-p 00000000 00:00 0 7fc587faa000-7fc588000000 ---p 00000000 00:00 0 7fc588000000-7fc58bf92000 rw-p 00000000 00:00 0 7fc58bf92000-7fc58c000000 ---p 00000000 00:00 0 7fc58c000000-7fc58ffae000 rw-p 00000000 00:00 0 7fc58ffae000-7fc590000000 ---p 00000000 00:00 0 7fc590000000-7fc593ee7000 rw-p 00000000 00:00 0 7fc593ee7000-7fc594000000 ---p 00000000 00:00 0 7fc594000000-7fc597f02000 rw-p 00000000 00:00 0 7fc597f02000-7fc598000000 ---p 00000000 00:00 0 7fc598000000-7fc59bf7e000 rw-p 00000000 00:00 0 7fc59bf7e000-7fc59c000000 ---p 00000000 00:00 0 7fc59c000000-7fc59ffdb000 rw-p 00000000 00:00 0 7fc59ffdb000-7fc5a0000000 ---p 00000000 00:00 0 7fc5a0000000-7fc5a3b34000 rw-p 00000000 00:00 0 7fc5a3b34000-7fc5a4000000 ---p 00000000 00:00 0 7fc5a4000000-7fc5a7f74000 rw-p 00000000 00:00 0 7fc5a7f74000-7fc5a8000000 ---p 00000000 00:00 0 7fc5a8000000-7fc5abf03000 rw-p 00000000 00:00 0 7fc5abf03000-7fc5ac000000 ---p 00000000 00:00 0 7fc5ac000000-7fc5aef40000 rw-p 00000000 00:00 0 7fc5aef40000-7fc5b0000000 ---p 00000000 00:00 0 7fc5b0000000-7fc5b3e93000 rw-p 00000000 00:00 0 7fc5b3e93000-7fc5b4000000 ---p 00000000 00:00 0 7fc5b4000000-7fc5b7f9d000 rw-p 00000000 00:00 0 7fc5b7f9d000-7fc5b8000000 ---p 00000000 00:00 0 7fc5b8000000-7fc5bbfff000 rw-p 00000000 00:00 0 7fc5bbfff000-7fc5bc000000 ---p 00000000 00:00 0 7fc5bc000000-7fc5bfef3000 rw-p 00000000 00:00 0 7fc5bfef3000-7fc5c0000000 ---p 00000000 00:00 0 7fc5c0000000-7fc5c06a9000 rw-p 00000000 00:00 0 7fc5c06a9000-7fc5c4000000 ---p 00000000 00:00 0 7fc5c4000000-7fc5c7fd0000 rw-p 00000000 00:00 0 7fc5c7fd0000-7fc5c8000000 ---p 00000000 00:00 0 7fc5c8000000-7fc5cbec2000 rw-p 00000000 00:00 0 7fc5cbec2000-7fc5cc000000 ---p 00000000 00:00 0 7fc5cc000000-7fc5cfff5000 rw-p 00000000 00:00 0 7fc5cfff5000-7fc5d0000000 ---p 00000000 00:00 0 7fc5d0000000-7fc5d304b000 rw-p 00000000 00:00 0 7fc5d304b000-7fc5d4000000 ---p 00000000 00:00 0 7fc5d4000000-7fc5d7fc5000 rw-p 00000000 00:00 0 7fc5d7fc5000-7fc5d8000000 ---p 00000000 00:00 0 7fc5d8000000-7fc5dbf8d000 rw-p 00000000 00:00 0 7fc5dbf8d000-7fc5dc000000 ---p 00000000 00:00 0 7fc5dc000000-7fc5dffed000 rw-p 00000000 00:00 0 7fc5dffed000-7fc5e0000000 ---p 00000000 00:00 0 7fc5e0000000-7fc5e3e7a000 rw-p 00000000 00:00 0 7fc5e3e7a000-7fc5e4000000 ---p 00000000 00:00 0 7fc5e4000000-7fc5e7fa0000 rw-p 00000000 00:00 0 7fc5e7fa0000-7fc5e8000000 ---p 00000000 00:00 0 7fc5e8000000-7fc5ebea4000 rw-p 00000000 00:00 0 7fc5ebea4000-7fc5ec000000 ---p 00000000 00:00 0 7fc5ec000000-7fc5eff36000 rw-p 00000000 00:00 0 7fc5eff36000-7fc5f0000000 ---p 00000000 00:00 0 7fc5f0000000-7fc5f3f98000 rw-p 00000000 00:00 0 7fc5f3f98000-7fc5f4000000 ---p 00000000 00:00 0 7fc5f4000000-7fc5f7f4b000 rw-p 00000000 00:00 0 7fc5f7f4b000-7fc5f8000000 ---p 00000000 00:00 0 7fc5f8000000-7fc5fbfb4000 rw-p 00000000 00:00 0 7fc5fbfb4000-7fc5fc000000 ---p 00000000 00:00 0 7fc5fc000000-7fc5fffaa000 rw-p 00000000 00:00 0 7fc5fffaa000-7fc600000000 ---p 00000000 00:00 0 7fc600000000-7fc603fd1000 rw-p 00000000 00:00 0 7fc603fd1000-7fc604000000 ---p 00000000 00:00 0 7fc604000000-7fc607902000 rw-p 00000000 00:00 0 7fc607902000-7fc608000000 ---p 00000000 00:00 0 7fc608000000-7fc60bfae000 rw-p 00000000 00:00 0 7fc60bfae000-7fc60c000000 ---p 00000000 00:00 0 7fc60c000000-7fc60ffc7000 rw-p 00000000 00:00 0 7fc60ffc7000-7fc610000000 ---p 00000000 00:00 0 7fc610000000-7fc613fe7000 rw-p 00000000 00:00 0 7fc613fe7000-7fc614000000 ---p 00000000 00:00 0 7fc614000000-7fc617f5d000 rw-p 00000000 00:00 0 7fc617f5d000-7fc618000000 ---p 00000000 00:00 0 7fc618000000-7fc61be48000 rw-p 00000000 00:00 0 7fc61be48000-7fc61c000000 ---p 00000000 00:00 0 7fc61c000000-7fc61ffd3000 rw-p 00000000 00:00 0 7fc61ffd3000-7fc620000000 ---p 00000000 00:00 0 7fc620000000-7fc623ff3000 rw-p 00000000 00:00 0 7fc623ff3000-7fc624000000 ---p 00000000 00:00 0 7fc624000000-7fc627ffa000 rw-p 00000000 00:00 0 7fc627ffa000-7fc628000000 ---p 00000000 00:00 0 7fc628000000-7fc62bfd1000 rw-p 00000000 00:00 0 7fc62bfd1000-7fc62c000000 ---p 00000000 00:00 0 7fc62c000000-7fc62fff2000 rw-p 00000000 00:00 0 7fc62fff2000-7fc630000000 ---p 00000000 00:00 0 7fc630000000-7fc633fe1000 rw-p 00000000 00:00 0 7fc633fe1000-7fc634000000 ---p 00000000 00:00 0 7fc634000000-7fc637e43000 rw-p 00000000 00:00 0 7fc637e43000-7fc638000000 ---p 00000000 00:00 0 7fc638000000-7fc63bfca000 rw-p 00000000 00:00 0 7fc63bfca000-7fc63c000000 ---p 00000000 00:00 0 7fc63c000000-7fc63ffdf000 rw-p 00000000 00:00 0 7fc63ffdf000-7fc640000000 ---p 00000000 00:00 0 7fc640000000-7fc643fcc000 rw-p 00000000 00:00 0 7fc643fcc000-7fc644000000 ---p 00000000 00:00 0 7fc644000000-7fc647e5a000 rw-p 00000000 00:00 0 7fc647e5a000-7fc648000000 ---p 00000000 00:00 0 7fc648000000-7fc64bff8000 rw-p 00000000 00:00 0 7fc64bff8000-7fc64c000000 ---p 00000000 00:00 0 7fc64c000000-7fc64fff1000 rw-p 00000000 00:00 0 7fc64fff1000-7fc650000000 ---p 00000000 00:00 0 7fc650000000-7fc653fe1000 rw-p 00000000 00:00 0 7fc653fe1000-7fc654000000 ---p 00000000 00:00 0 7fc654000000-7fc657ff1000 rw-p 00000000 00:00 0 7fc657ff1000-7fc658000000 ---p 00000000 00:00 0 7fc658000000-7fc65bfe7000 rw-p 00000000 00:00 0 7fc65bfe7000-7fc65c000000 ---p 00000000 00:00 0 7fc65c000000-7fc65ffe2000 rw-p 00000000 00:00 0 7fc65ffe2000-7fc660000000 ---p 00000000 00:00 0 7fc660000000-7fc663ff1000 rw-p 00000000 00:00 0 7fc663ff1000-7fc664000000 ---p 00000000 00:00 0 7fc664000000-7fc667f61000 rw-p 00000000 00:00 0 7fc667f61000-7fc668000000 ---p 00000000 00:00 0 7fc668000000-7fc66bfca000 rw-p 00000000 00:00 0 7fc66bfca000-7fc66c000000 ---p 00000000 00:00 0 7fc66c000000-7fc66ff41000 rw-p 00000000 00:00 0 7fc66ff41000-7fc670000000 ---p 00000000 00:00 0 7fc670000000-7fc673fc1000 rw-p 00000000 00:00 0 7fc673fc1000-7fc674000000 ---p 00000000 00:00 0 7fc674000000-7fc677ffa000 rw-p 00000000 00:00 0 7fc677ffa000-7fc678000000 ---p 00000000 00:00 0 7fc678000000-7fc67bff1000 rw-p 00000000 00:00 0 7fc67bff1000-7fc67c000000 ---p 00000000 00:00 0 7fc67c000000-7fc67ffe1000 rw-p 00000000 00:00 0 7fc67ffe1000-7fc680000000 ---p 00000000 00:00 0 7fc680000000-7fc683ff2000 rw-p 00000000 00:00 0 7fc683ff2000-7fc684000000 ---p 00000000 00:00 0 7fc684000000-7fc687ff2000 rw-p 00000000 00:00 0 7fc687ff2000-7fc688000000 ---p 00000000 00:00 0 7fc688000000-7fc68bfda000 rw-p 00000000 00:00 0 7fc68bfda000-7fc68c000000 ---p 00000000 00:00 0 7fc68c000000-7fc68ffd9000 rw-p 00000000 00:00 0 7fc68ffd9000-7fc690000000 ---p 00000000 00:00 0 7fc690000000-7fc693fea000 rw-p 00000000 00:00 0 7fc693fea000-7fc694000000 ---p 00000000 00:00 0 7fc694000000-7fc697ff1000 rw-p 00000000 00:00 0 7fc697ff1000-7fc698000000 ---p 00000000 00:00 0 7fc698000000-7fc69bfc2000 rw-p 00000000 00:00 0 7fc69bfc2000-7fc69c000000 ---p 00000000 00:00 0 7fc69c000000-7fc69ff12000 rw-p 00000000 00:00 0 7fc69ff12000-7fc6a0000000 ---p 00000000 00:00 0 7fc6a0000000-7fc6a3fb9000 rw-p 00000000 00:00 0 7fc6a3fb9000-7fc6a4000000 ---p 00000000 00:00 0 7fc6a4000000-7fc6a7cb2000 rw-p 00000000 00:00 0 7fc6a7cb2000-7fc6a8000000 ---p 00000000 00:00 0 7fc6a8000000-7fc6abfea000 rw-p 00000000 00:00 0 7fc6abfea000-7fc6ac000000 ---p 00000000 00:00 0 7fc6ac000000-7fc6affe1000 rw-p 00000000 00:00 0 7fc6affe1000-7fc6b0000000 ---p 00000000 00:00 0 7fc6b0000000-7fc6b3fda000 rw-p 00000000 00:00 0 7fc6b3fda000-7fc6b4000000 ---p 00000000 00:00 0 7fc6b4000000-7fc6b7eda000 rw-p 00000000 00:00 0 7fc6b7eda000-7fc6b8000000 ---p 00000000 00:00 0 7fc6b8000000-7fc6bbfe2000 rw-p 00000000 00:00 0 7fc6bbfe2000-7fc6bc000000 ---p 00000000 00:00 0 7fc6bc000000-7fc6bfffa000 rw-p 00000000 00:00 0 7fc6bfffa000-7fc6c0000000 ---p 00000000 00:00 0 7fc6c0000000-7fc6c3fea000 rw-p 00000000 00:00 0 7fc6c3fea000-7fc6c4000000 ---p 00000000 00:00 0 7fc6c4000000-7fc6c7ffa000 rw-p 00000000 00:00 0 7fc6c7ffa000-7fc6c8000000 ---p 00000000 00:00 0 7fc6c8000000-7fc6cbfc2000 rw-p 00000000 00:00 0 7fc6cbfc2000-7fc6cc000000 ---p 00000000 00:00 0 7fc6cc000000-7fc6cfff2000 rw-p 00000000 00:00 0 7fc6cfff2000-7fc6d0000000 ---p 00000000 00:00 0 7fc6d0000000-7fc6d3f2a000 rw-p 00000000 00:00 0 7fc6d3f2a000-7fc6d4000000 ---p 00000000 00:00 0 7fc6d4000000-7fc6d7fd2000 rw-p 00000000 00:00 0 7fc6d7fd2000-7fc6d8000000 ---p 00000000 00:00 0 7fc6d8000000-7fc6dbfca000 rw-p 00000000 00:00 0 7fc6dbfca000-7fc6dc000000 ---p 00000000 00:00 0 7fc6dc000000-7fc6dffe2000 rw-p 00000000 00:00 0 7fc6dffe2000-7fc6e0000000 ---p 00000000 00:00 0 7fc6e0000000-7fc6e3fb2000 rw-p 00000000 00:00 0 7fc6e3fb2000-7fc6e4000000 ---p 00000000 00:00 0 7fc6e4000000-7fc6e7fc2000 rw-p 00000000 00:00 0 7fc6e7fc2000-7fc6e8000000 ---p 00000000 00:00 0 7fc6e8000000-7fc6ebfc2000 rw-p 00000000 00:00 0 7fc6ebfc2000-7fc6ec000000 ---p 00000000 00:00 0 7fc6ec000000-7fc6effda000 rw-p 00000000 00:00 0 7fc6effda000-7fc6f0000000 ---p 00000000 00:00 0 7fc6f0000000-7fc6f3ff9000 rw-p 00000000 00:00 0 7fc6f3ff9000-7fc6f4000000 ---p 00000000 00:00 0 7fc6f4000000-7fc6f7ff2000 rw-p 00000000 00:00 0 7fc6f7ff2000-7fc6f8000000 ---p 00000000 00:00 0 7fc6f8000000-7fc6fbff2000 rw-p 00000000 00:00 0 7fc6fbff2000-7fc6fc000000 ---p 00000000 00:00 0 7fc6fc000000-7fc6fffc2000 rw-p 00000000 00:00 0 7fc6fffc2000-7fc700000000 ---p 00000000 00:00 0 7fc700000000-7fc703fea000 rw-p 00000000 00:00 0 7fc703fea000-7fc704000000 ---p 00000000 00:00 0 7fc704000000-7fc707fda000 rw-p 00000000 00:00 0 7fc707fda000-7fc708000000 ---p 00000000 00:00 0 7fc708000000-7fc70bffa000 rw-p 00000000 00:00 0 7fc70bffa000-7fc70c000000 ---p 00000000 00:00 0 7fc70c000000-7fc70ffca000 rw-p 00000000 00:00 0 7fc70ffca000-7fc710000000 ---p 00000000 00:00 0 7fc710000000-7fc713f52000 rw-p 00000000 00:00 0 7fc713f52000-7fc714000000 ---p 00000000 00:00 0 7fc714000000-7fc717fe2000 rw-p 00000000 00:00 0 7fc717fe2000-7fc718000000 ---p 00000000 00:00 0 7fc718000000-7fc71bfaa000 rw-p 00000000 00:00 0 7fc71bfaa000-7fc71c000000 ---p 00000000 00:00 0 7fc71c000000-7fc71ffda000 rw-p 00000000 00:00 0 7fc71ffda000-7fc720000000 ---p 00000000 00:00 0 7fc720000000-7fc723fc2000 rw-p 00000000 00:00 0 7fc723fc2000-7fc724000000 ---p 00000000 00:00 0 7fc724000000-7fc727fe2000 rw-p 00000000 00:00 0 7fc727fe2000-7fc728000000 ---p 00000000 00:00 0 7fc728000000-7fc72bfca000 rw-p 00000000 00:00 0 7fc72bfca000-7fc72c000000 ---p 00000000 00:00 0 7fc72c000000-7fc72fffa000 rw-p 00000000 00:00 0 7fc72fffa000-7fc730000000 ---p 00000000 00:00 0 7fc730000000-7fc733fe2000 rw-p 00000000 00:00 0 7fc733fe2000-7fc734000000 ---p 00000000 00:00 0 7fc734000000-7fc737fea000 rw-p 00000000 00:00 0 7fc737fea000-7fc738000000 ---p 00000000 00:00 0 7fc738000000-7fc73bfea000 rw-p 00000000 00:00 0 7fc73bfea000-7fc73c000000 ---p 00000000 00:00 0 7fc73c000000-7fc73fff2000 rw-p 00000000 00:00 0 7fc73fff2000-7fc740000000 ---p 00000000 00:00 0 7fc740000000-7fc743fea000 rw-p 00000000 00:00 0 7fc743fea000-7fc744000000 ---p 00000000 00:00 0 7fc744000000-7fc747fd2000 rw-p 00000000 00:00 0 7fc747fd2000-7fc748000000 ---p 00000000 00:00 0 7fc748000000-7fc74bfda000 rw-p 00000000 00:00 0 7fc74bfda000-7fc74c000000 ---p 00000000 00:00 0 7fc74c000000-7fc74ffda000 rw-p 00000000 00:00 0 7fc74ffda000-7fc750000000 ---p 00000000 00:00 0 7fc750000000-7fc753f62000 rw-p 00000000 00:00 0 7fc753f62000-7fc754000000 ---p 00000000 00:00 0 7fc754000000-7fc757fda000 rw-p 00000000 00:00 0 7fc757fda000-7fc758000000 ---p 00000000 00:00 0 7fc758000000-7fc75bff2000 rw-p 00000000 00:00 0 7fc75bff2000-7fc75c000000 ---p 00000000 00:00 0 7fc75c000000-7fc75fff2000 rw-p 00000000 00:00 0 7fc75fff2000-7fc760000000 ---p 00000000 00:00 0 7fc760000000-7fc763fef000 rw-p 00000000 00:00 0 7fc763fef000-7fc764000000 ---p 00000000 00:00 0 7fc764000000-7fc767ffa000 rw-p 00000000 00:00 0 7fc767ffa000-7fc768000000 ---p 00000000 00:00 0 7fc768000000-7fc76bfca000 rw-p 00000000 00:00 0 7fc76bfca000-7fc76c000000 ---p 00000000 00:00 0 7fc76c000000-7fc76fffa000 rw-p 00000000 00:00 0 7fc76fffa000-7fc770000000 ---p 00000000 00:00 0 7fc770000000-7fc773fca000 rw-p 00000000 00:00 0 7fc773fca000-7fc774000000 ---p 00000000 00:00 0 7fc774000000-7fc777fd2000 rw-p 00000000 00:00 0 7fc777fd2000-7fc778000000 ---p 00000000 00:00 0 7fc778000000-7fc77bff2000 rw-p 00000000 00:00 0 7fc77bff2000-7fc77c000000 ---p 00000000 00:00 0 7fc77c000000-7fc77fffe000 rw-p 00000000 00:00 0 7fc77fffe000-7fc780000000 ---p 00000000 00:00 0 7fc780000000-7fc783ff3000 rw-p 00000000 00:00 0 7fc783ff3000-7fc784000000 ---p 00000000 00:00 0 7fc784000000-7fc787ffa000 rw-p 00000000 00:00 0 7fc787ffa000-7fc788000000 ---p 00000000 00:00 0 7fc788000000-7fc78bffa000 rw-p 00000000 00:00 0 7fc78bffa000-7fc78c000000 ---p 00000000 00:00 0 7fc78c000000-7fc78ffca000 rw-p 00000000 00:00 0 7fc78ffca000-7fc790000000 ---p 00000000 00:00 0 7fc790000000-7fc793fea000 rw-p 00000000 00:00 0 7fc793fea000-7fc794000000 ---p 00000000 00:00 0 7fc794000000-7fc797fd2000 rw-p 00000000 00:00 0 7fc797fd2000-7fc798000000 ---p 00000000 00:00 0 7fc798000000-7fc79bfda000 rw-p 00000000 00:00 0 7fc79bfda000-7fc79c000000 ---p 00000000 00:00 0 7fc79c000000-7fc79fffa000 rw-p 00000000 00:00 0 7fc79fffa000-7fc7a0000000 ---p 00000000 00:00 0 7fc7a0000000-7fc7a3ffa000 rw-p 00000000 00:00 0 7fc7a3ffa000-7fc7a4000000 ---p 00000000 00:00 0 7fc7a4000000-7fc7a7fe6000 rw-p 00000000 00:00 0 7fc7a7fe6000-7fc7a8000000 ---p 00000000 00:00 0 7fc7a8000000-7fc7abfda000 rw-p 00000000 00:00 0 7fc7abfda000-7fc7ac000000 ---p 00000000 00:00 0 7fc7ac000000-7fc7affd2000 rw-p 00000000 00:00 0 7fc7affd2000-7fc7b0000000 ---p 00000000 00:00 0 7fc7b0000000-7fc7b3fef000 rw-p 00000000 00:00 0 7fc7b3fef000-7fc7b4000000 ---p 00000000 00:00 0 7fc7b4000000-7fc7b7ff2000 rw-p 00000000 00:00 0 7fc7b7ff2000-7fc7b8000000 ---p 00000000 00:00 0 7fc7b8000000-7fc7bbffa000 rw-p 00000000 00:00 0 7fc7bbffa000-7fc7bc000000 ---p 00000000 00:00 0 7fc7bc000000-7fc7bffea000 rw-p 00000000 00:00 0 7fc7bffea000-7fc7c0000000 ---p 00000000 00:00 0 7fc7c0000000-7fc7c3fc2000 rw-p 00000000 00:00 0 7fc7c3fc2000-7fc7c4000000 ---p 00000000 00:00 0 7fc7c4000000-7fc7c7fd3000 rw-p 00000000 00:00 0 7fc7c7fd3000-7fc7c8000000 ---p 00000000 00:00 0 7fc7c8000000-7fc7cbffa000 rw-p 00000000 00:00 0 7fc7cbffa000-7fc7cc000000 ---p 00000000 00:00 0 7fc7cc000000-7fc7cfffa000 rw-p 00000000 00:00 0 7fc7cfffa000-7fc7d0000000 ---p 00000000 00:00 0 7fc7d0000000-7fc7d3ff3000 rw-p 00000000 00:00 0 7fc7d3ff3000-7fc7d4000000 ---p 00000000 00:00 0 7fc7d4000000-7fc7d7ffe000 rw-p 00000000 00:00 0 7fc7d7ffe000-7fc7d8000000 ---p 00000000 00:00 0 7fc7d8000000-7fc7dbfdf000 rw-p 00000000 00:00 0 7fc7dbfdf000-7fc7dc000000 ---p 00000000 00:00 0 7fc7dc000000-7fc7dfff7000 rw-p 00000000 00:00 0 7fc7dfff7000-7fc7e0000000 ---p 00000000 00:00 0 7fc7e0000000-7fc7e3ffa000 rw-p 00000000 00:00 0 7fc7e3ffa000-7fc7e4000000 ---p 00000000 00:00 0 7fc7e4000000-7fc7e7fe2000 rw-p 00000000 00:00 0 7fc7e7fe2000-7fc7e8000000 ---p 00000000 00:00 0 7fc7e8000000-7fc7ebfe2000 rw-p 00000000 00:00 0 7fc7ebfe2000-7fc7ec000000 ---p 00000000 00:00 0 7fc7ec000000-7fc7efffb000 rw-p 00000000 00:00 0 7fc7efffb000-7fc7f0000000 ---p 00000000 00:00 0 7fc7f0000000-7fc7f3fef000 rw-p 00000000 00:00 0 7fc7f3fef000-7fc7f4000000 ---p 00000000 00:00 0 7fc7f4000000-7fc7f7f8b000 rw-p 00000000 00:00 0 7fc7f7f8b000-7fc7f8000000 ---p 00000000 00:00 0 7fc7f8000000-7fc7fbff4000 rw-p 00000000 00:00 0 7fc7fbff4000-7fc7fc000000 ---p 00000000 00:00 0 7fc7fc000000-7fc7fffef000 rw-p 00000000 00:00 0 7fc7fffef000-7fc800000000 ---p 00000000 00:00 0 7fc800000000-7fc803fff000 rw-p 00000000 00:00 0 7fc803fff000-7fc804000000 ---p 00000000 00:00 0 7fc804000000-7fc807fe7000 rw-p 00000000 00:00 0 7fc807fe7000-7fc808000000 ---p 00000000 00:00 0 7fc808000000-7fc80bfe7000 rw-p 00000000 00:00 0 7fc80bfe7000-7fc80c000000 ---p 00000000 00:00 0 7fc80c000000-7fc80ffe3000 rw-p 00000000 00:00 0 7fc80ffe3000-7fc810000000 ---p 00000000 00:00 0 7fc810000000-7fc813ffb000 rw-p 00000000 00:00 0 7fc813ffb000-7fc814000000 ---p 00000000 00:00 0 7fc814000000-7fc817ff7000 rw-p 00000000 00:00 0 7fc817ff7000-7fc818000000 ---p 00000000 00:00 0 7fc818000000-7fc81bfe3000 rw-p 00000000 00:00 0 7fc81bfe3000-7fc81c000000 ---p 00000000 00:00 0 7fc81c000000-7fc81ffff000 rw-p 00000000 00:00 0 7fc81ffff000-7fc820000000 ---p 00000000 00:00 0 7fc820000000-7fc823ffb000 rw-p 00000000 00:00 0 7fc823ffb000-7fc824000000 ---p 00000000 00:00 0 7fc824000000-7fc827ffb000 rw-p 00000000 00:00 0 7fc827ffb000-7fc828000000 ---p 00000000 00:00 0 7fc828000000-7fc82c000000 rw-p 00000000 00:00 0 7fc82c000000-7fc82fff3000 rw-p 00000000 00:00 0 7fc82fff3000-7fc830000000 ---p 00000000 00:00 0 7fc830000000-7fc833ff7000 rw-p 00000000 00:00 0 7fc833ff7000-7fc834000000 ---p 00000000 00:00 0 7fc834000000-7fc837ffb000 rw-p 00000000 00:00 0 7fc837ffb000-7fc838000000 ---p 00000000 00:00 0 7fc838000000-7fc83c000000 rw-p 00000000 00:00 0 7fc83c000000-7fc83fff0000 rw-p 00000000 00:00 0 7fc83fff0000-7fc840000000 ---p 00000000 00:00 0 7fc840000000-7fc843fc4000 rw-p 00000000 00:00 0 7fc843fc4000-7fc844000000 ---p 00000000 00:00 0 7fc844000000-7fc847ff4000 rw-p 00000000 00:00 0 7fc847ff4000-7fc848000000 ---p 00000000 00:00 0 7fc848000000-7fc84bfec000 rw-p 00000000 00:00 0 7fc84bfec000-7fc84c000000 ---p 00000000 00:00 0 7fc84c000000-7fc850000000 rw-p 00000000 00:00 0 7fc850000000-7fc853ff8000 rw-p 00000000 00:00 0 7fc853ff8000-7fc854000000 ---p 00000000 00:00 0 7fc854000000-7fc857ff2000 rw-p 00000000 00:00 0 7fc857ff2000-7fc858000000 ---p 00000000 00:00 0 7fc858000000-7fc85bffb000 rw-p 00000000 00:00 0 7fc85bffb000-7fc85c000000 ---p 00000000 00:00 0 7fc85c000000-7fc85fff0000 rw-p 00000000 00:00 0 7fc85fff0000-7fc860000000 ---p 00000000 00:00 0 7fc860000000-7fc863ffa000 rw-p 00000000 00:00 0 7fc863ffa000-7fc864000000 ---p 00000000 00:00 0 7fc864000000-7fc867ff8000 rw-p 00000000 00:00 0 7fc867ff8000-7fc868000000 ---p 00000000 00:00 0 7fc868000000-7fc86bfff000 rw-p 00000000 00:00 0 7fc86bfff000-7fc86c000000 ---p 00000000 00:00 0 7fc86c000000-7fc86ffc7000 rw-p 00000000 00:00 0 7fc86ffc7000-7fc870000000 ---p 00000000 00:00 0 7fc870000000-7fc873ffc000 rw-p 00000000 00:00 0 7fc873ffc000-7fc874000000 ---p 00000000 00:00 0 7fc874000000-7fc877ffb000 rw-p 00000000 00:00 0 7fc877ffb000-7fc878000000 ---p 00000000 00:00 0 7fc878000000-7fc87bff3000 rw-p 00000000 00:00 0 7fc87bff3000-7fc87c000000 ---p 00000000 00:00 0 7fc87c000000-7fc87ffff000 rw-p 00000000 00:00 0 7fc87ffff000-7fc880000000 ---p 00000000 00:00 0 7fc880000000-7fc883fff000 rw-p 00000000 00:00 0 7fc883fff000-7fc884000000 ---p 00000000 00:00 0 7fc884000000-7fc887ffa000 rw-p 00000000 00:00 0 7fc887ffa000-7fc888000000 ---p 00000000 00:00 0 7fc888000000-7fc88bf2c000 rw-p 00000000 00:00 0 7fc88bf2c000-7fc88c000000 ---p 00000000 00:00 0 7fc88c000000-7fc88fff7000 rw-p 00000000 00:00 0 7fc88fff7000-7fc890000000 ---p 00000000 00:00 0 7fc890000000-7fc893ff1000 rw-p 00000000 00:00 0 7fc893ff1000-7fc894000000 ---p 00000000 00:00 0 7fc894000000-7fc897ffe000 rw-p 00000000 00:00 0 7fc897ffe000-7fc898000000 ---p 00000000 00:00 0 7fc898000000-7fc89bff9000 rw-p 00000000 00:00 0 7fc89bff9000-7fc89c000000 ---p 00000000 00:00 0 7fc89c000000-7fc89ffaf000 rw-p 00000000 00:00 0 7fc89ffaf000-7fc8a0000000 ---p 00000000 00:00 0 7fc8a0000000-7fc8a3ff9000 rw-p 00000000 00:00 0 7fc8a3ff9000-7fc8a4000000 ---p 00000000 00:00 0 7fc8a4000000-7fc8a7ff5000 rw-p 00000000 00:00 0 7fc8a7ff5000-7fc8a8000000 ---p 00000000 00:00 0 7fc8a8000000-7fc8abffa000 rw-p 00000000 00:00 0 7fc8abffa000-7fc8ac000000 ---p 00000000 00:00 0 7fc8ac000000-7fc8affff000 rw-p 00000000 00:00 0 7fc8affff000-7fc8b0000000 ---p 00000000 00:00 0 7fc8b0000000-7fc8b3ffe000 rw-p 00000000 00:00 0 7fc8b3ffe000-7fc8b4000000 ---p 00000000 00:00 0 7fc8b4000000-7fc8b7ffd000 rw-p 00000000 00:00 0 7fc8b7ffd000-7fc8b8000000 ---p 00000000 00:00 0 7fc8b8000000-7fc8bbfe2000 rw-p 00000000 00:00 0 7fc8bbfe2000-7fc8bc000000 ---p 00000000 00:00 0 7fc8bc000000-7fc8c0000000 rw-p 00000000 00:00 0 7fc8c0000000-7fc8c3fff000 rw-p 00000000 00:00 0 7fc8c3fff000-7fc8c4000000 ---p 00000000 00:00 0 7fc8c4000000-7fc8c7ff9000 rw-p 00000000 00:00 0 7fc8c7ff9000-7fc8c8000000 ---p 00000000 00:00 0 7fc8c8000000-7fc8cbffe000 rw-p 00000000 00:00 0 7fc8cbffe000-7fc8cc000000 ---p 00000000 00:00 0 7fc8cc000000-7fc8cffff000 rw-p 00000000 00:00 0 7fc8cffff000-7fc8d0000000 ---p 00000000 00:00 0 7fc8d0000000-7fc8d3fff000 rw-p 00000000 00:00 0 7fc8d3fff000-7fc8d4000000 ---p 00000000 00:00 0 7fc8d4000000-7fc8d7ffb000 rw-p 00000000 00:00 0 7fc8d7ffb000-7fc8d8000000 ---p 00000000 00:00 0 7fc8d8000000-7fc8dbffe000 rw-p 00000000 00:00 0 7fc8dbffe000-7fc8dc000000 ---p 00000000 00:00 0 7fc8dc000000-7fc8dfffc000 rw-p 00000000 00:00 0 7fc8dfffc000-7fc8e0000000 ---p 00000000 00:00 0 7fc8e0000000-7fc8e3ff7000 rw-p 00000000 00:00 0 7fc8e3ff7000-7fc8e4000000 ---p 00000000 00:00 0 7fc8e4000000-7fc8e7fff000 rw-p 00000000 00:00 0 7fc8e7fff000-7fc8e8000000 ---p 00000000 00:00 0 7fc8e8000000-7fc8ebff1000 rw-p 00000000 00:00 0 7fc8ebff1000-7fc8ec000000 ---p 00000000 00:00 0 7fc8ec000000-7fc8efff8000 rw-p 00000000 00:00 0 7fc8efff8000-7fc8f0000000 ---p 00000000 00:00 0 7fc8f0000000-7fc8f3ffe000 rw-p 00000000 00:00 0 7fc8f3ffe000-7fc8f4000000 ---p 00000000 00:00 0 7fc8f4000000-7fc8f7ffd000 rw-p 00000000 00:00 0 7fc8f7ffd000-7fc8f8000000 ---p 00000000 00:00 0 7fc8f8000000-7fc8fbff9000 rw-p 00000000 00:00 0 7fc8fbff9000-7fc8fc000000 ---p 00000000 00:00 0 7fc8fc000000-7fc8fffe7000 rw-p 00000000 00:00 0 7fc8fffe7000-7fc900000000 ---p 00000000 00:00 0 7fc900000000-7fc903ffe000 rw-p 00000000 00:00 0 7fc903ffe000-7fc904000000 ---p 00000000 00:00 0 7fc904000000-7fc907ff1000 rw-p 00000000 00:00 0 7fc907ff1000-7fc908000000 ---p 00000000 00:00 0 7fc908000000-7fc90bffd000 rw-p 00000000 00:00 0 7fc90bffd000-7fc90c000000 ---p 00000000 00:00 0 7fc90c000000-7fc910021000 rw-p 00000000 00:00 0 7fc910021000-7fc914000000 ---p 00000000 00:00 0 7fc918000000-7fc918cd5000 rw-p 00000000 00:00 0 7fc918cd5000-7fc91c000000 ---p 00000000 00:00 0 7fc91c000000-7fc91c021000 rw-p 00000000 00:00 0 7fc91c021000-7fc920000000 ---p 00000000 00:00 0 7fc920000000-7fc924000000 rw-p 00000000 00:00 0 7fc924000000-7fc927ffe000 rw-p 00000000 00:00 0 7fc927ffe000-7fc928000000 ---p 00000000 00:00 0 7fc928000000-7fc92bfff000 rw-p 00000000 00:00 0 7fc92bfff000-7fc92c000000 ---p 00000000 00:00 0 7fc92c000000-7fc930000000 rw-p 00000000 00:00 0 7fc930000000-7fc933fff000 rw-p 00000000 00:00 0 7fc933fff000-7fc934000000 ---p 00000000 00:00 0 7fc934000000-7fc938000000 rw-p 00000000 00:00 0 7fc938000000-7fc93bffc000 rw-p 00000000 00:00 0 7fc93bffc000-7fc93c000000 ---p 00000000 00:00 0 7fc940000000-7fc943fef000 rw-p 00000000 00:00 0 7fc943fef000-7fc944000000 ---p 00000000 00:00 0 7fc948000000-7fc94c000000 rw-p 00000000 00:00 0 7fc94cfc7000-7fc94e6fd000 r-xp 00000000 08:01 693036 /usr/lib64/nvidia/libnvidia-compiler.so.375.26 7fc94e6fd000-7fc94e8fc000 ---p 01736000 08:01 693036 /usr/lib64/nvidia/libnvidia-compiler.so.375.26 7fc94e8fc000-7fc94ffd1000 rw-p 01735000 08:01 693036 /usr/lib64/nvidia/libnvidia-compiler.so.375.26 7fc94ffd1000-7fc950000000 rw-p 00000000 00:00 0 7fc950000000-7fc953fff000 rw-p 00000000 00:00 0 7fc953fff000-7fc954000000 ---p 00000000 00:00 0 7fc954e05000-7fc954e06000 ---p 00000000 00:00 0 7fc954e06000-7fc955606000 rwxp 00000000 00:00 0 [stack:44882] 7fc955606000-7fc955607000 ---p 00000000 00:00 0 7fc955607000-7fc955e07000 rwxp 00000000 00:00 0 [stack:44881] 7fc955e07000-7fc955e08000 ---p 00000000 00:00 0 7fc955e08000-7fc956608000 rwxp 00000000 00:00 0 [stack:44880] 7fc956608000-7fc956609000 ---p 00000000 00:00 0 7fc956609000-7fc956e09000 rwxp 00000000 00:00 0 [stack:44879] 7fc956e09000-7fc956e0a000 ---p 00000000 00:00 0 7fc956e0a000-7fc95760a000 rwxp 00000000 00:00 0 [stack:44878] 7fc95760a000-7fc957cd8000 r-xp 00000000 08:01 693030 /usr/lib64/nvidia/libcuda.so.375.26 7fc957cd8000-7fc957ed8000 ---p 006ce000 08:01 693030 /usr/lib64/nvidia/libcuda.so.375.26 7fc957ed8000-7fc957ff3000 rw-p 006ce000 08:01 693030 /usr/lib64/nvidia/libcuda.so.375.26 7fc957ff3000-7fc958000000 rw-p 00000000 00:00 0 7fc958000000-7fc95bfff000 rw-p 00000000 00:00 0 7fc95bfff000-7fc95c000000 ---p 00000000 00:00 0 7fc95c3e7000-7fc95cb07000 r-xp 00000000 08:01 693046 /usr/lib64/nvidia/libnvidia-opencl.so.375.26 7fc95cb07000-7fc95cd06000 ---p 00720000 08:01 693046 /usr/lib64/nvidia/libnvidia-opencl.so.375.26 7fc95cd06000-7fc95ce26000 rw-p 0071f000 08:01 693046 /usr/lib64/nvidia/libnvidia-opencl.so.375.26 7fc95ce26000-7fc960000000 rw-p 00000000 00:00 0 7fc960000000-7fc963fff000 rw-p 00000000 00:00 0 7fc963fff000-7fc964000000 ---p 00000000 00:00 0 7fc964306000-7fc9664ca000 rw-p 00000000 00:00 0 7fc9664ca000-7fc9664cb000 ---p 00000000 00:00 0 7fc9664cb000-7fc966ccb000 rwxp 00000000 00:00 0 [stack:44877] 7fc966ccb000-7fc966ccc000 ---p 00000000 00:00 0 7fc966ccc000-7fc9674cc000 rwxp 00000000 00:00 0 [stack:43334] 7fc9674cc000-7fc9674cd000 ---p 00000000 00:00 0 7fc9674cd000-7fc967ccd000 rwxp 00000000 00:00 0 [stack:43333] 7fc967ccd000-7fc967cce000 ---p 00000000 00:00 0 7fc967cce000-7fc9684ce000 rwxp 00000000 00:00 0 [stack:43332] 7fc9684ce000-7fc9684cf000 ---p 00000000 00:00 0 7fc9684cf000-7fc968ccf000 rwxp 00000000 00:00 0 [stack:43328] 7fc969282000-7fc9692c4000 r-xp 00000000 08:01 693040 /usr/lib64/nvidia/libnvidia-fatbinaryloader.so.375.26 7fc9692c4000-7fc9694c3000 ---p 00042000 08:01 693040 /usr/lib64/nvidia/libnvidia-fatbinaryloader.so.375.26 7fc9694c3000-7fc9694cd000 rw-p 00041000 08:01 693040 /usr/lib64/nvidia/libnvidia-fatbinaryloader.so.375.26 7fc9694cd000-7fc9694ce000 rw-p 00000000 00:00 0 7fc9694ce000-7fc9694cf000 ---p 00000000 00:00 0 7fc9694cf000-7fc969ccf000 rwxp 00000000 00:00 0 [stack:43331] 7fc969ccf000-7fc969cd0000 ---p 00000000 00:00 0 7fc969cd0000-7fc96a4d0000 rwxp 00000000 00:00 0 [stack:43330] 7fc96a4d0000-7fc96a4d1000 ---p 00000000 00:00 0 7fc96a4d1000-7fc96acd1000 rwxp 00000000 00:00 0 [stack:43329] 7fc96acd1000-7fc96acd8000 r-xp 00000000 08:01 528993 /usr/lib64/librt-2.17.so 7fc96acd8000-7fc96aed7000 ---p 00007000 08:01 528993 /usr/lib64/librt-2.17.so 7fc96aed7000-7fc96aed8000 r--p 00006000 08:01 528993 /usr/lib64/librt-2.17.so 7fc96aed8000-7fc96aed9000 rw-p 00007000 08:01 528993 /usr/lib64/librt-2.17.so 7fc96aed9000-7fc96aedc000 r-xp 00000000 08:01 528969 /usr/lib64/libdl-2.17.so 7fc96aedc000-7fc96b0db000 ---p 00003000 08:01 528969 /usr/lib64/libdl-2.17.so 7fc96b0db000-7fc96b0dc000 r--p 00002000 08:01 528969 /usr/lib64/libdl-2.17.so 7fc96b0dc000-7fc96b0dd000 rw-p 00003000 08:01 528969 /usr/lib64/libdl-2.17.so 7fc96b0dd000-7fc96b294000 r-xp 00000000 08:01 528963 /usr/lib64/libc-2.17.so 7fc96b294000-7fc96b494000 ---p 001b7000 08:01 528963 /usr/lib64/libc-2.17.so 7fc96b494000-7fc96b498000 r--p 001b7000 08:01 528963 /usr/lib64/libc-2.17.so 7fc96b498000-7fc96b49a000 rw-p 001bb000 08:01 528963 /usr/lib64/libc-2.17.so 7fc96b49a000-7fc96b49f000 rw-p 00000000 00:00 0 7fc96b49f000-7fc96b4b5000 r-xp 00000000 08:01 528989 /usr/lib64/libpthread-2.17.so 7fc96b4b5000-7fc96b6b5000 ---p 00016000 08:01 528989 /usr/lib64/libpthread-2.17.so 7fc96b6b5000-7fc96b6b6000 r--p 00016000 08:01 528989 /usr/lib64/libpthread-2.17.so 7fc96b6b6000-7fc96b6b7000 rw-p 00017000 08:01 528989 /usr/lib64/libpthread-2.17.so 7fc96b6b7000-7fc96b6bb000 rw-p 00000000 00:00 0 7fc96b6bb000-7fc96b6d0000 r-xp 00000000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7fc96b6d0000-7fc96b8cf000 ---p 00015000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7fc96b8cf000-7fc96b8d0000 r--p 00014000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7fc96b8d0000-7fc96b8d1000 rw-p 00015000 08:01 524307 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7fc96b8d1000-7fc96b8e7000 r-xp 00000000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7fc96b8e7000-7fc96bae6000 ---p 00016000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7fc96bae6000-7fc96bae7000 r--p 00015000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7fc96bae7000-7fc96bae8000 rw-p 00016000 08:01 530020 /usr/lib64/libgomp.so.1.0.0 7fc96bae8000-7fc96bbe9000 r-xp 00000000 08:01 528971 /usr/lib64/libm-2.17.so 7fc96bbe9000-7fc96bde8000 ---p 00101000 08:01 528971 /usr/lib64/libm-2.17.so 7fc96bde8000-7fc96bde9000 r--p 00100000 08:01 528971 /usr/lib64/libm-2.17.so 7fc96bde9000-7fc96bdea000 rw-p 00101000 08:01 528971 /usr/lib64/libm-2.17.so 7fc96bdea000-7fc96bed3000 r-xp 00000000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7fc96bed3000-7fc96c0d3000 ---p 000e9000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7fc96c0d3000-7fc96c0db000 r--p 000e9000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7fc96c0db000-7fc96c0dd000 rw-p 000f1000 08:01 529269 /usr/lib64/libstdc++.so.6.0.19 7fc96c0dd000-7fc96c0f2000 rw-p 00000000 00:00 0 7fc96c0f2000-7fc96c0f5000 r-xp 00000000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7fc96c0f5000-7fc96c2f4000 ---p 00003000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7fc96c2f4000-7fc96c2f5000 r--p 00002000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7fc96c2f5000-7fc96c2f6000 rw-p 00003000 00:25 99618989 /disk1/lib/boost_1_62/lib/libboost_system.so.1.62.0 7fc96c2f6000-7fc96c30d000 r-xp 00000000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7fc96c30d000-7fc96c50d000 ---p 00017000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7fc96c50d000-7fc96c50e000 r--p 00017000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7fc96c50e000-7fc96c50f000 rw-p 00018000 00:25 99619003 /disk1/lib/boost_1_62/lib/libboost_filesystem.so.1.62.0 7fc96c50f000-7fc96c514000 r-xp 00000000 08:01 690432 /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1.0.0 7fc96c514000-7fc96c714000 ---p 00005000 08:01 690432 /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1.0.0 7fc96c714000-7fc96c715000 rw-p 00005000 08:01 690432 /usr/local/cuda-8.0/targets/x86_64-linux/lib/libOpenCL.so.1.0.0 7fc96c715000-7fc96c736000 r-xp 00000000 08:01 558686 /usr/lib64/ld-2.17.so 7fc96c900000-7fc96c908000 rw-p 00000000 00:00 0 7fc96c90e000-7fc96c90f000 rw-p 00000000 00:00 0 7fc96c90f000-7fc96c910000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c910000-7fc96c911000 rw-s 1f3f080000 00:05 60806 /dev/nvidiactl 7fc96c911000-7fc96c912000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c912000-7fc96c913000 rw-s 1f83955000 00:05 60806 /dev/nvidiactl 7fc96c913000-7fc96c914000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c914000-7fc96c915000 rw-s 1ef50ba000 00:05 60806 /dev/nvidiactl 7fc96c915000-7fc96c916000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c916000-7fc96c917000 rw-s 1ef5a8f000 00:05 60806 /dev/nvidiactl 7fc96c917000-7fc96c918000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c918000-7fc96c919000 rw-s 1f003d3000 00:05 60806 /dev/nvidiactl 7fc96c919000-7fc96c91a000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c91a000-7fc96c91b000 rw-s 1f8e166000 00:05 60806 /dev/nvidiactl 7fc96c91b000-7fc96c91c000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c91c000-7fc96c91d000 rw-s 1c542eb000 00:05 60806 /dev/nvidiactl 7fc96c91d000-7fc96c91e000 rw-s 3bbffde3000 00:05 14325 /dev/nvidia0 7fc96c91e000-7fc96c91f000 rw-s 1ef4560000 00:05 60806 /dev/nvidiactl 7fc96c91f000-7fc96c920000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c920000-7fc96c921000 rw-s 1c44093000 00:05 60806 /dev/nvidiactl 7fc96c921000-7fc96c922000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c922000-7fc96c923000 rw-s 1f033dc000 00:05 60806 /dev/nvidiactl 7fc96c923000-7fc96c924000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c924000-7fc96c925000 rw-s 1f8bdfd000 00:05 60806 /dev/nvidiactl 7fc96c925000-7fc96c926000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c926000-7fc96c927000 rw-s 1f90512000 00:05 60806 /dev/nvidiactl 7fc96c927000-7fc96c928000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c928000-7fc96c929000 rw-s 1a73676000 00:05 60806 /dev/nvidiactl 7fc96c929000-7fc96c92a000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c92a000-7fc96c92b000 rw-s 1f2d810000 00:05 60806 /dev/nvidiactl 7fc96c92b000-7fc96c92c000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c92c000-7fc96c92d000 rw-s 1d0b49d000 00:05 60806 /dev/nvidiactl 7fc96c92d000-7fc96c92e000 rw-s 3bbffde2000 00:05 14325 /dev/nvidia0 7fc96c92e000-7fc96c92f000 r--s c8000000 00:05 61932 /dev/nvidia3 7fc96c92f000-7fc96c930000 r--s c9000000 00:05 60922 /dev/nvidia2 7fc96c930000-7fc96c931000 r--s 91000000 00:05 60860 /dev/nvidia1 7fc96c931000-7fc96c932000 r--s 92000000 00:05 14325 /dev/nvidia0 7fc96c932000-7fc96c933000 rw-s 1d0c4c2000 00:05 60806 /dev/nvidiactl 7fc96c933000-7fc96c936000 rw-p 00000000 00:00 0 7fc96c936000-7fc96c937000 r--p 00021000 08:01 558686 /usr/lib64/ld-2.17.so 7fc96c937000-7fc96c938000 rw-p 00022000 08:01 558686 /usr/lib64/ld-2.17.so 7fc96c938000-7fc96c939000 rw-p 00000000 00:00 0 7ffd81419000-7ffd8143a000 rwxp 00000000 00:00 0 [stack] 7ffd8143a000-7ffd8143b000 rw-p 00000000 00:00 0 7ffd8152d000-7ffd8152f000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] Aborted (core dumped)

Laurae2 commented 7 years ago

@billbargens Can you use gdb and print us the backtrace?

Tutorial for gdb in LightGBM: https://github.com/Microsoft/LightGBM/blob/master/docs/GPU-Windows.md#debugging-lightgbm-crashes-in-cli (just adapt the paths to yours) - remember to compile with the debug flag. It should spit out better details for debugging instead of what your backtrace.

billbargens commented 7 years ago

@Laurae2 But my production environment is CentOS7? The guide is about windows?

Laurae2 commented 7 years ago

@billbargens you have gcc (/usr/lib64/libgcc_s-4.8.5-20150702.so.1 in your debug code), so gdb must be available.

Windows guide uses Unix tools only (adapted for Windows case), so it doesn't matter if it's Windows or Linux operating system because it will work in most Unix systems.

billbargens commented 7 years ago

@Laurae2 Also, I found that even I compiled and build the tool without gpu-support and did training just with cpu, the task still failed with the similar error mesage!

Laurae2 commented 7 years ago

Compile LightGBM without GPU support and with the debug flag, and print us the gdb backtrace so we can look at the problem in details.

billbargens commented 7 years ago

Steps:

mkdir build cd build/ cmake -DCMAKE_BUILD_TYPE=Debug .. make gdb --args "./lightgbm" config=conf/submit1_leaves255_trees400_depthNone.conf

GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /disk1/LightGBM/lightgbm...done. (gdb) run Starting program: /disk1/LightGBM/./lightgbm config=conf/cet/submit1_leaves255_trees400_depthNone.conf [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". [New Thread 0x7ffff4db3700 (LWP 113295)] [Thread 0x7ffff4db3700 (LWP 113295) exited] [LightGBM] [Info] Finished loading parameters [New Thread 0x7ffff4db3700 (LWP 113296)] [New Thread 0x7ffff6db5700 (LWP 113297)] [New Thread 0x7ffff65b4700 (LWP 113298)] [New Thread 0x7ffff5db3700 (LWP 113299)] [New Thread 0x7ffff45b2700 (LWP 113300)] [New Thread 0x7ffff3db1700 (LWP 113301)] [New Thread 0x7ffff35b0700 (LWP 113302)] [LightGBM] [Info] Finished loading data in 12.206435 seconds [LightGBM] [Info] Number of positive: 100694, number of negative: 99742 [LightGBM] [Info] Total Bins 51742 [LightGBM] [Info] Number of data: 200436, number of used features: 25871 Error in `/disk1/LightGBM/./lightgbm': double free or corruption (out): 0x00000000ccf98260 ======= Backtrace: ========= /lib64/libc.so.6(+0x7d053)[0x7ffff6e33053] /disk1/LightGBM/./lightgbm(_ZN8LightGBM4GBDT17ResetTrainingDataEPKNS_14BoostingConfigEPKNS_7DatasetEPKNS_17ObjectiveFunctionERKSt6vectorIPKNS_6MetricESaISD_EE+0x1248)[0x446658] /disk1/LightGBM/./lightgbm(_ZN8LightGBM11Application9InitTrainEv+0x22c)[0x42d10c] /disk1/LightGBM/./lightgbm(main+0x2a)[0x4293aa] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7ffff6dd7b15] /disk1/LightGBM/./lightgbm[0x429b69] ======= Memory map: ======== 00400000-004fb000 r-xp 00000000 08:11 12321701 /disk1/LightGBM/lightgbm 006fa000-006fe000 r--p 000fa000 08:11 12321701 /disk1/LightGBM/lightgbm 006fe000-006ff000 rw-p 000fe000 08:11 12321701 /disk1/LightGBM/lightgbm 006ff000-cd7bd000 rw-p 00000000 00:00 0 [heap] 7fff80000000-7fff80021000 rw-p 00000000 00:00 0 7fff80021000-7fff84000000 ---p 00000000 00:00 0 7fff88000000-7fff885c0000 rw-p 00000000 00:00 0 7fff885c0000-7fff8c000000 ---p 00000000 00:00 0 7fff8c000000-7fff8cb48000 rw-p 00000000 00:00 0 7fff8cb48000-7fff90000000 ---p 00000000 00:00 0 7fff90000000-7fff905a4000 rw-p 00000000 00:00 0 7fff905a4000-7fff94000000 ---p 00000000 00:00 0 7fff94000000-7fff95928000 rw-p 00000000 00:00 0 7fff95928000-7fff98000000 ---p 00000000 00:00 0 7fff98000000-7fff9bf42000 rw-p 00000000 00:00 0 7fff9bf42000-7fff9c000000 ---p 00000000 00:00 0 7fff9c000000-7fff9fff9000 rw-p 00000000 00:00 0 7fff9fff9000-7fffa0000000 ---p 00000000 00:00 0 7fffa0000000-7fffa3e7b000 rw-p 00000000 00:00 0 7fffa3e7b000-7fffa4000000 ---p 00000000 00:00 0 7fffa8000000-7fffac000000 rw-p 00000000 00:00 0 7fffb0000000-7fffb4000000 rw-p 00000000 00:00 0 7fffb8000000-7fffbbfc2000 rw-p 00000000 00:00 0 7fffbbfc2000-7fffbc000000 ---p 00000000 00:00 0 7fffbc000000-7fffbffff000 rw-p 00000000 00:00 0 7fffbffff000-7fffc0000000 ---p 00000000 00:00 0 7fffc0000000-7fffc3fc2000 rw-p 00000000 00:00 0 7fffc3fc2000-7fffc4000000 ---p 00000000 00:00 0 7fffc8000000-7fffcbfc2000 rw-p 00000000 00:00 0 7fffcbfc2000-7fffcc000000 ---p 00000000 00:00 0 7fffd0000000-7fffd3fc2000 rw-p 00000000 00:00 0 7fffd3fc2000-7fffd4000000 ---p 00000000 00:00 0 7fffd8000000-7fffdbfc2000 rw-p 00000000 00:00 0 7fffdbfc2000-7fffdc000000 ---p 00000000 00:00 0 7fffdc000000-7fffdffff000 rw-p 00000000 00:00 0 7fffdffff000-7fffe0000000 ---p 00000000 00:00 0 7fffe0000000-7fffe3fc2000 rw-p 00000000 00:00 0 7fffe3fc2000-7fffe4000000 ---p 00000000 00:00 0 7fffe4000000-7fffe7e2e000 rw-p 00000000 00:00 0 7fffe7e2e000-7fffe8000000 ---p 00000000 00:00 0 7fffe8000000-7fffebfc2000 rw-p 00000000 00:00 0 7fffebfc2000-7fffec000000 ---p 00000000 00:00 0 7fffeca16000-7fffefbe3000 rw-p 00000000 00:00 0 7ffff2db0000-7ffff2db1000 ---p 00000000 00:00 0 7ffff2db1000-7ffff35b1000 rw-p 00000000 00:00 0 [stack:113302] 7ffff35b1000-7ffff35b2000 ---p 00000000 00:00 0 7ffff35b2000-7ffff3db2000 rw-p 00000000 00:00 0 [stack:113301] 7ffff3db2000-7ffff3db3000 ---p 00000000 00:00 0 7ffff3db3000-7ffff45b3000 rw-p 00000000 00:00 0 [stack:113300] 7ffff45b3000-7ffff45b4000 ---p 00000000 00:00 0 7ffff45b4000-7ffff4db4000 rw-p 00000000 00:00 0 [stack:113296] 7ffff55b3000-7ffff55b4000 ---p 00000000 00:00 0 7ffff55b4000-7ffff5db4000 rw-p 00000000 00:00 0 [stack:113299] 7ffff5db4000-7ffff5db5000 ---p 00000000 00:00 0 7ffff5db5000-7ffff65b5000 rw-p 00000000 00:00 0 [stack:113298] 7ffff65b5000-7ffff65b6000 ---p 00000000 00:00 0 7ffff65b6000-7ffff6db6000 rw-p 00000000 00:00 0 [stack:113297] 7ffff6db6000-7ffff6f6d000 r-xp 00000000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff6f6d000-7ffff716d000 ---p 001b7000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff716d000-7ffff7171000 r--p 001b7000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff7171000-7ffff7173000 rw-p 001bb000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff7173000-7ffff7178000 rw-p 00000000 00:00 0 7ffff7178000-7ffff718e000 r-xp 00000000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff718e000-7ffff738e000 ---p 00016000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff738e000-7ffff738f000 r--p 00016000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff738f000-7ffff7390000 rw-p 00017000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff7390000-7ffff7394000 rw-p 00000000 00:00 0 7ffff7394000-7ffff73a9000 r-xp 00000000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff73a9000-7ffff75a8000 ---p 00015000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff75a8000-7ffff75a9000 r--p 00014000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff75a9000-7ffff75aa000 rw-p 00015000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff75aa000-7ffff75cf000 r-xp 00000000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff75cf000-7ffff77ce000 ---p 00025000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff77ce000-7ffff77cf000 r--p 00024000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff77cf000-7ffff77d0000 rw-p 00025000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff77d0000-7ffff78d1000 r-xp 00000000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff78d1000-7ffff7ad0000 ---p 00101000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff7ad0000-7ffff7ad1000 r--p 00100000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff7ad1000-7ffff7ad2000 rw-p 00101000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff7ad2000-7ffff7bbb000 r-xp 00000000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7bbb000-7ffff7dbb000 ---p 000e9000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7dbb000-7ffff7dc4000 r--p 000e9000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7dc4000-7ffff7dc6000 rw-p 000f2000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7dc6000-7ffff7ddb000 rw-p 00000000 00:00 0 7ffff7ddb000-7ffff7dfc000 r-xp 00000000 08:01 1871194 /usr/lib64/ld-2.17.so 7ffff7fc7000-7ffff7fce000 rw-p 00000000 00:00 0 7ffff7ff7000-7ffff7ffa000 rw-p 00000000 00:00 0 7ffff7ffa000-7ffff7ffc000 r-xp 00000000 00:00 0 [vdso] 7ffff7ffc000-7ffff7ffd000 r--p 00021000 08:01 1871194 /usr/lib64/ld-2.17.so 7ffff7ffd000-7ffff7ffe000 rw-p 00022000 08:01 1871194 /usr/lib64/ld-2.17.so 7ffff7ffe000-7ffff7fff000 rw-p 00000000 00:00 0 7ffffffdd000-7ffffffff000 rw-p 00000000 00:00 0 [stack] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]

Program received signal SIGABRT, Aborted. 0x00007ffff6deb5f7 in raise () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install glibc-2.17-106.el7_2.8.x86_64 libgcc-4.8.5-11.el7.x86_64 libgomp-4.8.5-11.el7.x86_64 libstdc++-4.8.5-11.el7.x86_64

Laurae2 commented 7 years ago

You have mangled names with addresses only on your backtrace like on the previous logs, which means LightGBM was not compiled with debugging flags:

======= Backtrace: =========
/lib64/libc.so.6(+0x7d053)[0x7ffff6e33053]
/disk1/LightGBM/./lightgbm(_ZN8LightGBM4GBDT17ResetTrainingDataEPKNS_14BoostingConfigEPKNS_7DatasetEPKNS_17ObjectiveFunctionERKSt6vectorIPKNS_6MetricESaISD_EE+0x1248)[0x446658]
/disk1/LightGBM/./lightgbm(_ZN8LightGBM11Application9InitTrainEv+0x22c)[0x42d10c]
/disk1/LightGBM/./lightgbm(main+0x2a)[0x4293aa]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7ffff6dd7b15]
/disk1/LightGBM/./lightgbm[0x429b69]

Did you wipe the old LightGBM files? If not, the compiler will skip compiling the new files and it will not compile with debug correctly. To make sure you use a clean LightGBM installation with debug, use a new folder as if you install a fresh LightGBM (including git clone step, DCMAKE_BUILD_TYPE=Debug, etc.). Check this if it is still causing issue even if you use a fresh directory: http://stackoverflow.com/questions/10005982/how-do-you-set-gdb-debug-flag-with-cmake

Also, use make VERBOSE=1 to make sure you are using only debug, you should not see any -O2 or -O3 flags appearing during compilation, and there must not be sudden large skips in % during compilation.

You should get explicit function names and lines if you compiled with debug correctly, like:

(gdb) backtrace
#0  0x00007ffbb37c11f1 in strlen () from C:\Windows\system32\msvcrt.dll
#1  0x000000000048bbe5 in std::char_traits<char>::length (__s=0x0)
    at C:/PROGRA~1/MINGW-~1/X86_64~1.0-P/mingw64/x86_64-w64-mingw32/include/c++/bits/char_traits.h:267
#2  std::operator+<char, std::char_traits<char>, std::allocator<char> > (__rhs="\\", __lhs=0x0)
    at C:/PROGRA~1/MINGW-~1/X86_64~1.0-P/mingw64/x86_64-w64-mingw32/include/c++/bits/basic_string.tcc:1157
#3  boost::compute::detail::appdata_path[abi:cxx11]() () at C:/boost/boost-build/include/boost/compute/detail/path.hpp:38
#4  0x000000000048eec3 in boost::compute::detail::program_binary_path (hash="d27987d5bd61e2d28cd32b8d7a7916126354dc81", create=create@entry=false)
    at C:/boost/boost-build/include/boost/compute/detail/path.hpp:46
#5  0x00000000004913de in boost::compute::program::load_program_binary (hash="d27987d5bd61e2d28cd32b8d7a7916126354dc81", ctx=...)
    at C:/boost/boost-build/include/boost/compute/program.hpp:605
#6  0x0000000000490ece in boost::compute::program::build_with_source (
    source="\n#ifndef _HISTOGRAM_256_KERNEL_\n#define _HISTOGRAM_256_KERNEL_\n\n#pragma OPENCL EXTENSION cl_khr_local_int32_base_atomics : enable\n#pragma OPENC
L EXTENSION cl_khr_global_int32_base_atomics : enable\n\n//"..., context=...,
    options=" -D POWER_FEATURE_WORKGROUPS=5 -D USE_CONSTANT_BUF=0 -D USE_DP_FLOAT=0 -D CONST_HESSIAN=0 -cl-strict-aliasing -cl-mad-enable -cl-no-signed-zeros -c
l-fast-relaxed-math") at C:/boost/boost-build/include/boost/compute/program.hpp:549
#7  0x0000000000454339 in LightGBM::GPUTreeLearner::BuildGPUKernels () at C:\xgboost\LightGBM\src\treelearner\gpu_tree_learner.cpp:583
#8  0x00000000636044f2 in libgomp-1!GOMP_parallel () from C:\Program Files\mingw-w64\x86_64-5.3.0-posix-seh-rt_v4-rev0\mingw64\bin\libgomp-1.dll
#9  0x0000000000455e7e in LightGBM::GPUTreeLearner::BuildGPUKernels (this=this@entry=0x3b9cac0)
    at C:\xgboost\LightGBM\src\treelearner\gpu_tree_learner.cpp:569
#10 0x0000000000457b49 in LightGBM::GPUTreeLearner::InitGPU (this=0x3b9cac0, platform_id=<optimized out>, device_id=<optimized out>)
    at C:\xgboost\LightGBM\src\treelearner\gpu_tree_learner.cpp:720
#11 0x0000000000410395 in LightGBM::GBDT::ResetTrainingData (this=0x1f26c90, config=<optimized out>, train_data=0x1f28180, objective_function=0x1f280e0,
    training_metrics=std::vector of length 2, capacity 2 = {...}) at C:\xgboost\LightGBM\src\boosting\gbdt.cpp:98
#12 0x0000000000402e93 in LightGBM::Application::InitTrain (this=this@entry=0x23f9d0) at C:\xgboost\LightGBM\src\application\application.cpp:213
---Type <return> to continue, or q <return> to quit---
#13 0x00000000004f0b55 in LightGBM::Application::Run (this=0x23f9d0) at C:/xgboost/LightGBM/include/LightGBM/application.h:84
#14 main (argc=6, argv=0x1f21e90) at C:\xgboost\LightGBM\src\main.cpp:7

which pinpoints immediately where the problem is (just an example).

billbargens commented 7 years ago

Following your advice, I rebuilded the source code. But it seemed that the tool was still not compiled with debugging flags.

I also tried to add the configurations in CMakeLists.txt, but I can still see many -O3 flags appearing during compilation:

SET(CMAKE_BUILD_TYPE "Debug")
SET(CMAKE_CXX_FLAGS_DEBUG "$ENV{CXXFLAGS} -O0 -Wall -g2 -ggdb")

Clone clean source code

git clone --recursive https://github.com/Microsoft/LightGBM

CMake with Debug Mode

mkdir build cd build/ cmake -DCMAKE_BUILD_TYPE=Debug ..

-- The C compiler identification is GNU 4.8.5 -- The CXX compiler identification is GNU 4.8.5 -- Check for working C compiler: /usr/bin/cc -- Check for working C compiler: /usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /usr/bin/c++ -- Check for working CXX compiler: /usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- Try OpenMP C flag = [-fopenmp] -- Performing Test OpenMP_FLAG_DETECTED -- Performing Test OpenMP_FLAG_DETECTED - Success -- Try OpenMP CXX flag = [-fopenmp] -- Performing Test OpenMP_FLAG_DETECTED -- Performing Test OpenMP_FLAG_DETECTED - Success -- Found OpenMP: -fopenmp
-- Configuring done -- Generating done -- Build files have been written to: /disk1/LightGBM/build

Compile

make VERBOSE=1

/usr/local/bin/cmake -H/disk1/LightGBM -B/disk1/LightGBM/build --check-build-system CMakeFiles/Makefile.cmake 0 /usr/local/bin/cmake -E cmake_progress_start /disk1/LightGBM/build/CMakeFiles /disk1/LightGBM/build/CMakeFiles/progress.marks make -f CMakeFiles/Makefile2 all make[1]: Entering directory /disk1/LightGBM/build' make -f CMakeFiles/_lightgbm.dir/build.make CMakeFiles/_lightgbm.dir/depend make[2]: Entering directory/disk1/LightGBM/build' cd /disk1/LightGBM/build && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /disk1/LightGBM /disk1/LightGBM /disk1/LightGBM/build /disk1/LightGBM/build /disk1/LightGBM/build/CMakeFiles/_lightgbm.dir/DependInfo.cmake --color= Dependee "/disk1/LightGBM/build/CMakeFiles/_lightgbm.dir/DependInfo.cmake" is newer than depender "/disk1/LightGBM/build/CMakeFiles/_lightgbm.dir/depend.internal". Dependee "/disk1/LightGBM/build/CMakeFiles/CMakeDirectoryInformation.cmake" is newer than depender "/disk1/LightGBM/build/CMakeFiles/_lightgbm.dir/depend.internal". Scanning dependencies of target _lightgbm make[2]: Leaving directory /disk1/LightGBM/build' make -f CMakeFiles/_lightgbm.dir/build.make CMakeFiles/_lightgbm.dir/build make[2]: Entering directory/disk1/LightGBM/build' [ 2%] Building CXX object CMakeFiles/_lightgbm.dir/src/c_api.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/c_api.cpp.o -c /disk1/LightGBM/src/c_api.cpp [ 4%] Building CXX object CMakeFiles/_lightgbm.dir/src/application/application.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/application/application.cpp.o -c /disk1/LightGBM/src/application/application.cpp [ 6%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/boosting.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/boosting/boosting.cpp.o -c /disk1/LightGBM/src/boosting/boosting.cpp [ 8%] Building CXX object CMakeFiles/_lightgbm.dir/src/boosting/gbdt.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/boosting/gbdt.cpp.o -c /disk1/LightGBM/src/boosting/gbdt.cpp [ 10%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/bin.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/bin.cpp.o -c /disk1/LightGBM/src/io/bin.cpp [ 12%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/config.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/config.cpp.o -c /disk1/LightGBM/src/io/config.cpp [ 14%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/dataset.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/dataset.cpp.o -c /disk1/LightGBM/src/io/dataset.cpp [ 16%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/dataset_loader.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/dataset_loader.cpp.o -c /disk1/LightGBM/src/io/dataset_loader.cpp [ 18%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/metadata.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/metadata.cpp.o -c /disk1/LightGBM/src/io/metadata.cpp [ 20%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/parser.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/parser.cpp.o -c /disk1/LightGBM/src/io/parser.cpp [ 22%] Building CXX object CMakeFiles/_lightgbm.dir/src/io/tree.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/io/tree.cpp.o -c /disk1/LightGBM/src/io/tree.cpp [ 24%] Building CXX object CMakeFiles/_lightgbm.dir/src/metric/dcg_calculator.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/metric/dcg_calculator.cpp.o -c /disk1/LightGBM/src/metric/dcg_calculator.cpp [ 26%] Building CXX object CMakeFiles/_lightgbm.dir/src/metric/metric.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/metric/metric.cpp.o -c /disk1/LightGBM/src/metric/metric.cpp [ 28%] Building CXX object CMakeFiles/_lightgbm.dir/src/objective/objective_function.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/objective/objective_function.cpp.o -c /disk1/LightGBM/src/objective/objective_function.cpp [ 30%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linker_topo.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/network/linker_topo.cpp.o -c /disk1/LightGBM/src/network/linker_topo.cpp [ 32%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linkers_mpi.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/network/linkers_mpi.cpp.o -c /disk1/LightGBM/src/network/linkers_mpi.cpp [ 34%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/linkers_socket.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/network/linkers_socket.cpp.o -c /disk1/LightGBM/src/network/linkers_socket.cpp [ 36%] Building CXX object CMakeFiles/_lightgbm.dir/src/network/network.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/network/network.cpp.o -c /disk1/LightGBM/src/network/network.cpp [ 38%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/data_parallel_tree_learner.cpp [ 40%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/feature_parallel_tree_learner.cpp [ 42%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/gpu_tree_learner.cpp [ 44%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/serial_tree_learner.cpp [ 46%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/treelearner/tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/tree_learner.cpp [ 48%] Building CXX object CMakeFiles/_lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -D_lightgbm_EXPORTS -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -fPIC -o CMakeFiles/_lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/voting_parallel_tree_learner.cpp [ 50%] Linking CXX shared library ../lib_lightgbm.so /usr/local/bin/cmake -E cmake_link_script CMakeFiles/_lightgbm.dir/link.txt --verbose=1 /usr/bin/c++ -fPIC -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -shared -Wl,-soname,lib_lightgbm.so -o ../lib_lightgbm.so CMakeFiles/_lightgbm.dir/src/c_api.cpp.o CMakeFiles/_lightgbm.dir/src/application/application.cpp.o CMakeFiles/_lightgbm.dir/src/boosting/boosting.cpp.o CMakeFiles/_lightgbm.dir/src/boosting/gbdt.cpp.o CMakeFiles/_lightgbm.dir/src/io/bin.cpp.o CMakeFiles/_lightgbm.dir/src/io/config.cpp.o CMakeFiles/_lightgbm.dir/src/io/dataset.cpp.o CMakeFiles/_lightgbm.dir/src/io/dataset_loader.cpp.o CMakeFiles/_lightgbm.dir/src/io/metadata.cpp.o CMakeFiles/_lightgbm.dir/src/io/parser.cpp.o CMakeFiles/_lightgbm.dir/src/io/tree.cpp.o CMakeFiles/_lightgbm.dir/src/metric/dcg_calculator.cpp.o CMakeFiles/_lightgbm.dir/src/metric/metric.cpp.o CMakeFiles/_lightgbm.dir/src/objective/objective_function.cpp.o CMakeFiles/_lightgbm.dir/src/network/linker_topo.cpp.o CMakeFiles/_lightgbm.dir/src/network/linkers_mpi.cpp.o CMakeFiles/_lightgbm.dir/src/network/linkers_socket.cpp.o CMakeFiles/_lightgbm.dir/src/network/network.cpp.o CMakeFiles/_lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o CMakeFiles/_lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o CMakeFiles/_lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o CMakeFiles/_lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o CMakeFiles/_lightgbm.dir/src/treelearner/tree_learner.cpp.o CMakeFiles/_lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o make[2]: Leaving directory /disk1/LightGBM/build' [ 50%] Built target _lightgbm make -f CMakeFiles/lightgbm.dir/build.make CMakeFiles/lightgbm.dir/depend make[2]: Entering directory/disk1/LightGBM/build' cd /disk1/LightGBM/build && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /disk1/LightGBM /disk1/LightGBM /disk1/LightGBM/build /disk1/LightGBM/build /disk1/LightGBM/build/CMakeFiles/lightgbm.dir/DependInfo.cmake --color= Dependee "/disk1/LightGBM/build/CMakeFiles/lightgbm.dir/DependInfo.cmake" is newer than depender "/disk1/LightGBM/build/CMakeFiles/lightgbm.dir/depend.internal". Dependee "/disk1/LightGBM/build/CMakeFiles/CMakeDirectoryInformation.cmake" is newer than depender "/disk1/LightGBM/build/CMakeFiles/lightgbm.dir/depend.internal". Scanning dependencies of target lightgbm make[2]: Leaving directory /disk1/LightGBM/build' make -f CMakeFiles/lightgbm.dir/build.make CMakeFiles/lightgbm.dir/build make[2]: Entering directory/disk1/LightGBM/build' [ 52%] Building CXX object CMakeFiles/lightgbm.dir/src/main.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/main.cpp.o -c /disk1/LightGBM/src/main.cpp [ 54%] Building CXX object CMakeFiles/lightgbm.dir/src/application/application.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/application/application.cpp.o -c /disk1/LightGBM/src/application/application.cpp [ 56%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/boosting.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/boosting/boosting.cpp.o -c /disk1/LightGBM/src/boosting/boosting.cpp [ 58%] Building CXX object CMakeFiles/lightgbm.dir/src/boosting/gbdt.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/boosting/gbdt.cpp.o -c /disk1/LightGBM/src/boosting/gbdt.cpp [ 60%] Building CXX object CMakeFiles/lightgbm.dir/src/io/bin.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/bin.cpp.o -c /disk1/LightGBM/src/io/bin.cpp [ 62%] Building CXX object CMakeFiles/lightgbm.dir/src/io/config.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/config.cpp.o -c /disk1/LightGBM/src/io/config.cpp [ 64%] Building CXX object CMakeFiles/lightgbm.dir/src/io/dataset.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/dataset.cpp.o -c /disk1/LightGBM/src/io/dataset.cpp [ 66%] Building CXX object CMakeFiles/lightgbm.dir/src/io/dataset_loader.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/dataset_loader.cpp.o -c /disk1/LightGBM/src/io/dataset_loader.cpp [ 68%] Building CXX object CMakeFiles/lightgbm.dir/src/io/metadata.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/metadata.cpp.o -c /disk1/LightGBM/src/io/metadata.cpp [ 70%] Building CXX object CMakeFiles/lightgbm.dir/src/io/parser.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/parser.cpp.o -c /disk1/LightGBM/src/io/parser.cpp [ 72%] Building CXX object CMakeFiles/lightgbm.dir/src/io/tree.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/io/tree.cpp.o -c /disk1/LightGBM/src/io/tree.cpp [ 74%] Building CXX object CMakeFiles/lightgbm.dir/src/metric/dcg_calculator.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/metric/dcg_calculator.cpp.o -c /disk1/LightGBM/src/metric/dcg_calculator.cpp [ 76%] Building CXX object CMakeFiles/lightgbm.dir/src/metric/metric.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/metric/metric.cpp.o -c /disk1/LightGBM/src/metric/metric.cpp [ 78%] Building CXX object CMakeFiles/lightgbm.dir/src/objective/objective_function.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/objective/objective_function.cpp.o -c /disk1/LightGBM/src/objective/objective_function.cpp [ 80%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linker_topo.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/network/linker_topo.cpp.o -c /disk1/LightGBM/src/network/linker_topo.cpp [ 82%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linkers_mpi.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/network/linkers_mpi.cpp.o -c /disk1/LightGBM/src/network/linkers_mpi.cpp [ 84%] Building CXX object CMakeFiles/lightgbm.dir/src/network/linkers_socket.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/network/linkers_socket.cpp.o -c /disk1/LightGBM/src/network/linkers_socket.cpp [ 86%] Building CXX object CMakeFiles/lightgbm.dir/src/network/network.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/network/network.cpp.o -c /disk1/LightGBM/src/network/network.cpp [ 88%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/data_parallel_tree_learner.cpp [ 90%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/feature_parallel_tree_learner.cpp [ 92%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/gpu_tree_learner.cpp [ 94%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/serial_tree_learner.cpp [ 96%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/treelearner/tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/tree_learner.cpp [ 98%] Building CXX object CMakeFiles/lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o /usr/bin/c++ -DUSE_SOCKET -I/disk1/LightGBM/include -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g -o CMakeFiles/lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o -c /disk1/LightGBM/src/treelearner/voting_parallel_tree_learner.cpp [100%] Linking CXX executable ../lightgbm /usr/local/bin/cmake -E cmake_link_script CMakeFiles/lightgbm.dir/link.txt --verbose=1 /usr/bin/c++ -fopenmp -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native -fPIC -g CMakeFiles/lightgbm.dir/src/main.cpp.o CMakeFiles/lightgbm.dir/src/application/application.cpp.o CMakeFiles/lightgbm.dir/src/boosting/boosting.cpp.o CMakeFiles/lightgbm.dir/src/boosting/gbdt.cpp.o CMakeFiles/lightgbm.dir/src/io/bin.cpp.o CMakeFiles/lightgbm.dir/src/io/config.cpp.o CMakeFiles/lightgbm.dir/src/io/dataset.cpp.o CMakeFiles/lightgbm.dir/src/io/dataset_loader.cpp.o CMakeFiles/lightgbm.dir/src/io/metadata.cpp.o CMakeFiles/lightgbm.dir/src/io/parser.cpp.o CMakeFiles/lightgbm.dir/src/io/tree.cpp.o CMakeFiles/lightgbm.dir/src/metric/dcg_calculator.cpp.o CMakeFiles/lightgbm.dir/src/metric/metric.cpp.o CMakeFiles/lightgbm.dir/src/objective/objective_function.cpp.o CMakeFiles/lightgbm.dir/src/network/linker_topo.cpp.o CMakeFiles/lightgbm.dir/src/network/linkers_mpi.cpp.o CMakeFiles/lightgbm.dir/src/network/linkers_socket.cpp.o CMakeFiles/lightgbm.dir/src/network/network.cpp.o CMakeFiles/lightgbm.dir/src/treelearner/data_parallel_tree_learner.cpp.o CMakeFiles/lightgbm.dir/src/treelearner/feature_parallel_tree_learner.cpp.o CMakeFiles/lightgbm.dir/src/treelearner/gpu_tree_learner.cpp.o CMakeFiles/lightgbm.dir/src/treelearner/serial_tree_learner.cpp.o CMakeFiles/lightgbm.dir/src/treelearner/tree_learner.cpp.o CMakeFiles/lightgbm.dir/src/treelearner/voting_parallel_tree_learner.cpp.o -o ../lightgbm -rdynamic make[2]: Leaving directory /disk1/LightGBM/build' [100%] Built target lightgbm make[1]: Leaving directory/disk1/LightGBM/build' /usr/local/bin/cmake -E cmake_progress_start /disk1/LightGBM/build/CMakeFiles 0

huanzhang12 commented 7 years ago

@billbargens Are you using the latest master branch of LightGBM? I encountered a similar problem before, which is a bug in GBDT::ResetTrainingData(). This should be already fixed PR #402. Maybe there is an similar bug somewhere else, but I need a full backtrace to analyze the problem. I suggest you clone a clean copy of LightGBM and rerun CMake with -DCMAKE_BUILD_TYPE=debug

billbargens commented 7 years ago

@huanzhang12 Yes, I have tried to provide the full backtrace logs. I cloned and rebuilded the source code with debug flag. But it seemed that the tool was still not compiled with debugging flags. Refer to my last reply!

huanzhang12 commented 7 years ago

In your last reply I saw that debugging flags were applied (-g is there), so your are good. Just reproduce the crash and get the backtrace ;)

billbargens commented 7 years ago

@huanzhang12

gdb --args "./lightgbm" config=conf/cet/submit1_leaves255_trees400_depthNone.conf GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /disk1/LightGBM/lightgbm...done. (gdb) run Starting program: /disk1/LightGBM/./lightgbm config=conf/cet/submit1_leaves255_trees400_depthNone.conf [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". [New Thread 0x7ffff4db3700 (LWP 96059)] [Thread 0x7ffff4db3700 (LWP 96059) exited] [LightGBM] [Info] Finished loading parameters [LightGBM] [Info] Finished loading data in 12.010578 seconds [LightGBM] [Info] Number of positive: 100694, number of negative: 99742 [LightGBM] [Info] Total Bins 51742 [LightGBM] [Info] Number of data: 200436, number of used features: 25871 Error in `/disk1/LightGBM/./lightgbm': double free or corruption (out): 0x000000010ae257c0 ======= Backtrace: ========= /lib64/libc.so.6(+0x7d053)[0x7ffff6e33053] /disk1/LightGBM/./lightgbm(_ZN8LightGBM4GBDT17ResetTrainingDataEPKNS_14BoostingConfigEPKNS_7DatasetEPKNS_17ObjectiveFunctionERKSt6vectorIPKNS_6MetricESaISD_EE+0x1248)[0x446658] /disk1/LightGBM/./lightgbm(_ZN8LightGBM11Application9InitTrainEv+0x22c)[0x42d10c] /disk1/LightGBM/./lightgbm(main+0x2a)[0x4293aa] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7ffff6dd7b15] /disk1/LightGBM/./lightgbm[0x429b69] ======= Memory map: ======== 00400000-004fb000 r-xp 00000000 08:11 34866231 /disk1/LightGBM/lightgbm 006fa000-006fe000 r--p 000fa000 08:11 34866231 /disk1/LightGBM/lightgbm 006fe000-006ff000 rw-p 000fe000 08:11 34866231 /disk1/LightGBM/lightgbm 006ff000-10b4b2000 rw-p 00000000 00:00 0 [heap] 7fffe8000000-7fffe8021000 rw-p 00000000 00:00 0 7fffe8021000-7fffec000000 ---p 00000000 00:00 0 7fffee219000-7ffff13e6000 rw-p 00000000 00:00 0 7ffff45b3000-7ffff45b4000 ---p 00000000 00:00 0 7ffff45b4000-7ffff4db4000 rw-p 00000000 00:00 0 7ffff6db6000-7ffff6f6d000 r-xp 00000000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff6f6d000-7ffff716d000 ---p 001b7000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff716d000-7ffff7171000 r--p 001b7000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff7171000-7ffff7173000 rw-p 001bb000 08:01 1839746 /usr/lib64/libc-2.17.so 7ffff7173000-7ffff7178000 rw-p 00000000 00:00 0 7ffff7178000-7ffff718e000 r-xp 00000000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff718e000-7ffff738e000 ---p 00016000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff738e000-7ffff738f000 r--p 00016000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff738f000-7ffff7390000 rw-p 00017000 08:01 1839772 /usr/lib64/libpthread-2.17.so 7ffff7390000-7ffff7394000 rw-p 00000000 00:00 0 7ffff7394000-7ffff73a9000 r-xp 00000000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff73a9000-7ffff75a8000 ---p 00015000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff75a8000-7ffff75a9000 r--p 00014000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff75a9000-7ffff75aa000 rw-p 00015000 08:01 1891398 /usr/lib64/libgcc_s-4.8.5-20150702.so.1 7ffff75aa000-7ffff75cf000 r-xp 00000000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff75cf000-7ffff77ce000 ---p 00025000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff77ce000-7ffff77cf000 r--p 00024000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff77cf000-7ffff77d0000 rw-p 00025000 08:01 1840944 /usr/lib64/libgomp.so.1.0.0 7ffff77d0000-7ffff78d1000 r-xp 00000000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff78d1000-7ffff7ad0000 ---p 00101000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff7ad0000-7ffff7ad1000 r--p 00100000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff7ad1000-7ffff7ad2000 rw-p 00101000 08:01 1839754 /usr/lib64/libm-2.17.so 7ffff7ad2000-7ffff7bbb000 r-xp 00000000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7bbb000-7ffff7dbb000 ---p 000e9000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7dbb000-7ffff7dc4000 r--p 000e9000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7dc4000-7ffff7dc6000 rw-p 000f2000 08:01 1840038 /usr/lib64/libstdc++.so.6.0.19 7ffff7dc6000-7ffff7ddb000 rw-p 00000000 00:00 0 7ffff7ddb000-7ffff7dfc000 r-xp 00000000 08:01 1871194 /usr/lib64/ld-2.17.so 7ffff7fc7000-7ffff7fce000 rw-p 00000000 00:00 0 7ffff7ff7000-7ffff7ffa000 rw-p 00000000 00:00 0 7ffff7ffa000-7ffff7ffc000 r-xp 00000000 00:00 0 [vdso] 7ffff7ffc000-7ffff7ffd000 r--p 00021000 08:01 1871194 /usr/lib64/ld-2.17.so 7ffff7ffd000-7ffff7ffe000 rw-p 00022000 08:01 1871194 /usr/lib64/ld-2.17.so 7ffff7ffe000-7ffff7fff000 rw-p 00000000 00:00 0 7ffffffdd000-7ffffffff000 rw-p 00000000 00:00 0 [stack] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]

Program received signal SIGABRT, Aborted. 0x00007ffff6deb5f7 in raise () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install glibc-2.17-106.el7_2.8.x86_64 libgcc-4.8.5-11.el7.x86_64 libgomp-4.8.5-11.el7.x86_64 libstdc++-4.8.5-11.el7.x86_64

huanzhang12 commented 7 years ago

The backtrace still does not include the source line number, which is weird. You can probably try to install debuginfo packages, see here: https://access.redhat.com/solutions/1506273 Other suggestions:

Can you try to checkout an earlier commit https://github.com/Microsoft/LightGBM/commit/9224a9d12521aae4fc47e25974a856bd2321ecad and see if it works? Just do "git checkout 9224a9d" in your cloned repository, remove the build folder and try again.
Does this crash occur when you are not using the GPU? Based on the backtrace, the GPU has not been initialized yet; it crashes before any GPU code can run.
Does this crash occur on other datasets?

billbargens commented 7 years ago

Yes, I have mentioned in the early reply that it has nothing to do with the GPU support. I compiled and built the tool without gpu support. And then do training with cpu, the task still failed with the similar error message!

Laurae2 commented 7 years ago

@billbargens I found something wrong thanks to your verbose log during compilation.

After cloning the repository locally on a fresh new folder, but just before using cmake, go to the CMakeLists.txt file (https://github.com/Microsoft/LightGBM/blob/master/CMakeLists.txt#L50) and change line 48-50:

if(UNIX OR MINGW OR CYGWIN)
    SET(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -pthread -O3 -Wall -std=c++11 -Wno-ignored-attributes -march=core2 -mtune=native")
endif()

to this:

if(UNIX OR MINGW OR CYGWIN)
    SET(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -pthread -Wall -std=c++11 -Wno-ignored-attributes")
endif()

The latter "should" work (there seems to be inconsistent behaviors of cmake vs cmake-gui, which does not make sense). Then compile with debug flag as usual.

huanzhang12 commented 7 years ago

@billbargens I see. So you probably want to remove the [GPU] tag in the issue title... I can't reproduce the issue because I don't have the dataset, but here is the general procedure to debug this problem:

Try to find the smallest dataset that crashes LightGBM.
Save the datasets to binary format by setting save_binary=true. Next time just remove the save_binary flag and LightGBM will load datafile much faster (this will greatly reduce time in the next step).
Then, run LightGBM under valgrind, a memory checker. Valgrind should report some out-of-bound memory access, preferably with source line numbers. This will greatly help us fix the bug.

guolinke commented 7 years ago

@billbargens any updates ?

anttttti commented 7 years ago

I had the same issue. Sigsegv when training. Checking out 9224a9d fixed the issue.

Strangely this happened in only 1 of 3 Ubuntu 16.04 machines, with all packages updated to current. Only CPU should be different, laptop i7-4810MQ on the sigsegv machine, desktop i7 and xeon on the other two.

github-actions[bot] commented 1 year ago

This issue has been automatically locked since there has not been any recent activity since it was closed. To start a new related discussion, open a new issue at https://github.com/microsoft/LightGBM/issues including a reference to this.

microsoft / LightGBM

can not do training #436

Environment info

Configurations

Error Message

Install

Training with cpu

Training with GPU

Clone clean source code

CMake with Debug Mode

Compile