Build xgboost with gcc-6.3

sh1ng commented 4 years ago

Original idea to build xgboost statically with libstdc++ didn't work out.
Use devtoolset-6 for x86_64 and gcc installed from sources for ppc64le
xgboost package had 2 copies of libxgboost.so now it's fixed and it will reduce package size a bit
Add ability to test whl with default python(found an issue when import lgbm and I'll address it in a separate PR)
Install whl with --constraint ../../../src/interface_py/requirements_buildonly.txt prevents update dependencies to a last version

sh1ng commented 4 years ago

Program received signal SIGSEGV, Segmentation fault.
0x00007fffaf2ee9a0 in length (this=0x7fffffff3290)
    at /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/basic_string.h:3129
3129    /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/basic_string.h: No such file or directory.
(gdb) bt
#0  0x00007fffaf2ee9a0 in length (this=0x7fffffff3290)
    at /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/basic_string.h:3129
#1  __copy<char> (
    s=<error reading variable: Cannot access memory at address 0x10>, 
    dest=@0x1622a20: 0x0)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++11/cxx11-shim_facets.cc:482
#2  std::__facet_shims::__numpunct_fill_cache<char> (
    f=0x7fffbc037760 <(anonymous namespace)::ctype_w>, c=0x1622a10)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++11/cxx11-shim_facets.cc:514
#3  0x00007fffaf2f49fd in numpunct_shim (c=0x1622a10, 
    f=0x7fffbc037760 <(anonymous namespace)::ctype_w>, this=0xeafae0)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++11/cxx11-shim_facets.cc:238
#4  std::locale::facet::_M_sso_shim (
    this=0x7fffbc037760 <(anonymous namespace)::ctype_w>, 
    which=<optimized out>)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++11/cxx11-shim_facets.cc:797
#5  0x00007fffaf2a2706 in std::locale::_Impl::_M_install_facet (
    this=0x7fffbc0383e0 <(anonymous namespace)::c_locale_impl>, 
    __idp=<optimized out>, 
    __fp=0x7fffbc037760 <(anonymous namespace)::ctype_w>)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++98/locale.cc:372
#6  0x00007fffaf29ac50 in _M_init_facet<std::ctype<wchar_t> > (
---Type <return> to continue, or q <return> to quit---
    __facet=0x7fffbc037760 <(anonymous namespace)::ctype_w>, 
    this=0x7fffbc0383e0 <(anonymous namespace)::c_locale_impl>)
    at /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/locale_classes.h:602
#7  std::locale::_Impl::_Impl (
    this=0x7fffbc0383e0 <(anonymous namespace)::c_locale_impl>, 
    __refs=<optimized out>)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++98/locale_init.cc:509
#8  0x00007fffaf29b615 in std::locale::_S_initialize_once ()
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++98/locale_init.cc:307
#9  0x00007ffff76a2e40 in pthread_once () from /usr/lib64/libpthread.so.0
#10 0x00007fffaf29b661 in __gthread_once (
    __func=0x7fffaf29b600 <std::locale::_S_initialize_once()>, 
    __once=<optimized out>)
    at /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/x86_64-unknown-linux-gnu/bits/gthr-default.h:699
#11 std::locale::_S_initialize ()
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++98/locale_init.cc:316
#12 0x00007fffaf29b6a3 in std::locale::locale (
    this=0x7fffbc038d98 <__gnu_internal::buf_cout_sync+56>)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++98/locale_init.cc:250
#13 0x00007fffaf29d434 in basic_streambuf (this=<optimized out>)
    at /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/streambuf:---Type <return> to continue, or q <return> to quit---
466
#14 stdio_sync_filebuf (__f=0x7ffff6f87400 <_IO_2_1_stdout_>, 
    this=<optimized out>)
    at /gcc-5.3.0-build/x86_64-unknown-linux-gnu/libstdc++-v3/include/ext/stdio_sync_filebuf.h:80
#15 std::ios_base::Init::Init (this=<optimized out>)
    at ../../../../../gcc-5.3.0/libstdc++-v3/src/c++98/ios_init.cc:85
#16 0x00007fffaef75cd0 in __static_initialization_and_destruction_0 (
    __priority=65535, __initialize_p=1)
    at /usr/local/include/c++/5.3.0/iostream:74
#17 _GLOBAL__sub_I_xgbfi.cc(void) ()
    at /root/repo/xgboost/src/analysis/xgbfi.cc:594
#18 0x00007ffff7dea8f3 in _dl_init_internal () from /lib64/ld-linux-x86-64.so.2
#19 0x00007ffff7def4ce in dl_open_worker () from /lib64/ld-linux-x86-64.so.2
#20 0x00007ffff7dea704 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2
#21 0x00007ffff7deeabb in _dl_open () from /lib64/ld-linux-x86-64.so.2
#22 0x00007ffff7492eeb in dlopen_doit () from /usr/lib64/libdl.so.2
#23 0x00007ffff7dea704 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2
#24 0x00007ffff74934ed in _dlerror_run () from /usr/lib64/libdl.so.2
#25 0x00007ffff7492f81 in dlopen@@GLIBC_2.2.5 () from /usr/lib64/libdl.so.2
#26 0x00007ffff2347e11 in py_dl_open ()

sh1ng commented 4 years ago

Numpy is broken on ppc64le https://github.com/numpy/numpy/issues/14147

h2oai / h2o4gpu

Build xgboost with gcc-6.3 #790