search

nnstreamer / nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.
Apache License 2.0
134 stars 71 forks source link

Running examples on PC issue #2602

Closed udit01 closed 1 month ago

udit01 commented 1 month ago

I have tried to install nntrainer by 3 methods.

PPA

I followed the steps in the guide . All the dependencies and nntrainer were installed. But then when I try to build & test the resnet18 example, it shows nnstreamer-test-dev not installed, even though I installed that one by PPA too. The complete error log is given in the issue: #2600

meson-build

Then I tried installing from source using meson build exactly as written in the guide, it builds but then when I run $ ninja -C build install it failed in several gmock cases, with an error log which I have attached below. To mitigate any other problems I re-installed gmock and gtest from source as given in this answer: https://stackoverflow.com/questions/36086037/cant-build-c-c-program-with-gmock-gmock-h-too-many-errors-are-generated

using the official google-test repository.

Even after re-installing google-test and all other libraries, it still shows the errors.

Linux self hosted build using debian/ubuntu tools

Same steps as above were performed, but ultimately when ninja was run, a similar error log was generated.

Please let me know how can it be run.

Error log for procedure 2: 

(base) udit@anon:~/viproj/nntrainer$ ninja -C build install
ninja: Entering directory `build'
[2/343] Compiling C++ object test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o
FAILED: test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o 
c++ -Itest/unittest/layers/unittest_layers.p -Itest/unittest/layers -I../test/unittest/layers -Inntrainer -I../nntrainer -Iapi -I../api -I../api/ccapi/include -Inntrainer/compiler -I../nntrainer/compiler -Inntrainer/dataset -I../nntrainer/dataset -Inntrainer/layers/loss -I../nntrainer/layers/loss -Inntrainer/layers -I../nntrainer/layers -Inntrainer/models -I../nntrainer/models -Inntrainer/optimizers -I../nntrainer/optimizers -Inntrainer/tensor -I../nntrainer/tensor -Inntrainer/utils -I../nntrainer/utils -Inntrainer/graph -I../nntrainer/graph -I../test/include -I/usr/include/x86_64-linux-gnu/openblas-pthread/ -I/usr/include/iniparser -I/usr/include/nnstreamer -I/usr/include/tensorflow2/ -I/usr/include/opencv4 -fdiagnostics-color=always -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -Wnon-virtual-dtor -Werror -std=c++17 '-DVERSION="0.5.0"' -DVERSION_MAJOR=0 -DVERSION_MINOR=5 -DVERSION_MICRO=0 -Wredundant-decls -Wwrite-strings -Wformat -Wformat-nonliteral -Wformat-security -Winit-self -Waddress -Wvla -Wpointer-arith -Wno-error=varargs -ftree-vectorize -Wno-maybe-uninitialized -Wno-unused-variable -DMIN_CPP_VERSION=201703L -DOPENCL_KERNEL_PATH=nntrainer_opencl_kernels -DML_API_COMMON=1 -DNNSTREAMER_AVAILABLE=1 -DUSE_BLAS=1 -DNNTR_NUM_THREADS=1 -DOMP_NUM_THREADS=1 -D__LOGGING__=1 -DENABLE_TEST=1 -DREDUCE_TOLERANCE=1 -DENABLE_NNSTREAMER_BACKBONE=1 -DENABLE_TFLITE_BACKBONE=1 -DENABLE_TFLITE_INTERPRETER=1 -DENABLE_DATA_AUGMENTATION_OPENCV=1 '-DNNTRAINER_CONF_PATH="/etc/nntrainer.ini"' -g -O2 -ffile-prefix-map=/home/udit/viproj/nntrainer=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fopenmp -pthread -DGTEST_HAS_PTHREAD=1 -Wno-maybe-uninitialized -MD -MQ test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o -MF test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o.d -o test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o -c ../test/unittest/layers/unittest_layers_impl.cpp
../test/unittest/layers/unittest_layers_impl.cpp:58:49: error: ‘testing::Values’ is not a type
   58 | GTEST_PARAMETER_TEST(LayerImpl, LayerSemantics, ::testing::Values(semantic_tc));
      |                                                 ^~
../test/unittest/layers/unittest_layers_impl.cpp:58:80: error: expected constructor, destructor, or type conversion before ‘;’ token
   58 | GTEST_PARAMETER_TEST(LayerImpl, LayerSemantics, ::testing::Values(semantic_tc));
      |                                                                                ^
[3/343] Compiling C++ object test/unittest/unittest_common_properties.p/unittest_common_properties.cpp.o
FAILED: test/unittest/unittest_common_properties.p/unittest_common_properties.cpp.o 
c++ -Itest/unittest/unittest_common_properties.p -Itest/unittest -I../test/unittest -Itest/unittest/models -I../test/unittest/models -Inntrainer -I../nntrainer -Iapi -I../api -I../api/ccapi/include -Inntrainer/compiler -I../nntrainer/compiler -Inntrainer/dataset -I../nntrainer/dataset -Inntrainer/layers/loss -I../nntrainer/layers/loss -Inntrainer/layers -I../nntrainer/layers -Inntrainer/models -I../nntrainer/models -Inntrainer/optimizers -I../nntrainer/optimizers -Inntrainer/tensor -I../nntrainer/tensor -Inntrainer/utils -I../nntrainer/utils -Inntrainer/graph -I../nntrainer/graph -I../test/include -I/usr/include/x86_64-linux-gnu/openblas-pthread/ -I/usr/include/iniparser -I/usr/include/nnstreamer -I/usr/include/tensorflow2/ -I/usr/include/opencv4 -fdiagnostics-color=always -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -Wnon-virtual-dtor -Werror -std=c++17 '-DVERSION="0.5.0"' -DVERSION_MAJOR=0 -DVERSION_MINOR=5 -DVERSION_MICRO=0 -Wredundant-decls -Wwrite-strings -Wformat -Wformat-nonliteral -Wformat-security -Winit-self -Waddress -Wvla -Wpointer-arith -Wno-error=varargs -ftree-vectorize -Wno-maybe-uninitialized -Wno-unused-variable -DMIN_CPP_VERSION=201703L -DOPENCL_KERNEL_PATH=nntrainer_opencl_kernels -DML_API_COMMON=1 -DNNSTREAMER_AVAILABLE=1 -DUSE_BLAS=1 -DNNTR_NUM_THREADS=1 -DOMP_NUM_THREADS=1 -D__LOGGING__=1 -DENABLE_TEST=1 -DREDUCE_TOLERANCE=1 -DENABLE_NNSTREAMER_BACKBONE=1 -DENABLE_TFLITE_BACKBONE=1 -DENABLE_TFLITE_INTERPRETER=1 -DENABLE_DATA_AUGMENTATION_OPENCV=1 '-DNNTRAINER_CONF_PATH="/etc/nntrainer.ini"' -g -O2 -ffile-prefix-map=/home/udit/viproj/nntrainer=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fopenmp -pthread -DGTEST_HAS_PTHREAD=1 -MD -MQ test/unittest/unittest_common_properties.p/unittest_common_properties.cpp.o -MF test/unittest/unittest_common_properties.p/unittest_common_properties.cpp.o.d -o test/unittest/unittest_common_properties.p/unittest_common_properties.cpp.o -c ../test/unittest/unittest_common_properties.cpp
../test/unittest/unittest_common_properties.cpp:34:21: error: expected constructor, destructor, or type conversion before ‘(’ token
   34 | GTEST_PARAMETER_TEST(NamePropertyTests, NamePropertyTest,
      |                     ^
../test/unittest/unittest_common_properties.cpp:67:21: error: expected constructor, destructor, or type conversion before ‘(’ token
   67 | GTEST_PARAMETER_TEST(ForbiddenSuffixTests, NameTest,
      |                     ^
[11/343] Linking target nntrainer/libnntrainer.so
nntrainer/compiler/tf_schema_generated.h:642:6: warning: type ‘tflite::BuiltinOperator’ violates the C++ One Definition Rule [-Wodr]
  642 | enum BuiltinOperator : int32_t {
      |      ^
/usr/include/tensorflow2/lite/schema/schema_generated.h:1008:6: note: an enum with different value name is defined in another translation unit
 1008 | enum BuiltinOperator : int32_t {
      |      ^
nntrainer/compiler/tf_schema_generated.h:802:3: note: name ‘BuiltinOperator_MIN’ differs from name ‘BuiltinOperator_BITCAST’ defined in another translation unit
  802 |   BuiltinOperator_MIN = BuiltinOperator_ADD,
      |   ^
/usr/include/tensorflow2/lite/schema/schema_generated.h:1168:3: note: mismatching definition
 1168 |   BuiltinOperator_BITCAST = 159,
      |   ^
ninja: build stopped: subcommand failed.

Error log for procedure 3 build step:

$ export DEB_BUILD_OPTIONS="parallel=$(($(cat /proc/cpuinfo |grep processor|wc -l) + 1))"
cd nntrainer && time debuild -us -uc
 dpkg-buildpackage -us -uc -ui
dpkg-buildpackage: info: source package nntrainer
dpkg-buildpackage: info: source version 0.5.0
dpkg-buildpackage: info: source distribution unstable
dpkg-buildpackage: info: source changed by jijoongmoon <jijoong.moon@samsung.com>
 dpkg-source --before-build .
dpkg-buildpackage: info: host architecture amd64
 fakeroot debian/rules clean
dh clean --parallel
dh: warning: Compatibility levels before 10 are deprecated (level 9 in use)
   debian/rules override_dh_auto_clean
make[1]: Entering directory '/home/udit/viproj/nntrainer'
rm -rf build
make[1]: Leaving directory '/home/udit/viproj/nntrainer'
   debian/rules override_dh_clean
make[1]: Entering directory '/home/udit/viproj/nntrainer'
dh_clean override_dh_clean
dh_clean: warning: Compatibility levels before 10 are deprecated (level 9 in use)
make[1]: Leaving directory '/home/udit/viproj/nntrainer'
 dpkg-source -b .
dpkg-source: warning: no source format specified in debian/source/format, see dpkg-source(1)
dpkg-source: warning: source directory 'nntrainer' is not <sourcepackage>-<upstreamversion> 'nntrainer-0.5.0'
dpkg-source: info: using source format '1.0'
dpkg-source: info: building nntrainer in nntrainer_0.5.0.tar.gz
dpkg-source: info: building nntrainer in nntrainer_0.5.0.dsc
 debian/rules build
dh build --parallel
dh: warning: Compatibility levels before 10 are deprecated (level 9 in use)
   dh_update_autotools_config -O--parallel
   debian/rules override_dh_auto_configure
make[1]: Entering directory '/home/udit/viproj/nntrainer'
mkdir -p build
meson --buildtype=plain --prefix=/usr --sysconfdir=/etc \
    --libdir=lib/x86_64-linux-gnu --bindir=lib/nntrainer/bin \
    --includedir=include -Dinstall-app=true \
    -Dreduce-tolerance=true \
    -Denable-debug=false \
    -Dml-api-support=enabled \
    -Denable-nnstreamer-tensor-filter=enabled \
    -Denable-nnstreamer-tensor-trainer=enabled \
                -Denable-nnstreamer-backbone=true \
                -Dcapi-ml-common-actual=capi-ml-common \
                -Dcapi-ml-inference-actual=capi-ml-inference \
                -Denable-capi=enabled \
    build
The Meson build system
Version: 0.61.2
Source dir: /home/udit/viproj/nntrainer
Build dir: /home/udit/viproj/nntrainer/build
Build type: native build
Project name: nntrainer
Project version: 0.5.0
C compiler for the host machine: cc (gcc 11.4.0 "cc (Ubuntu 11.4.0-2ubuntu1~18.04) 11.4.0")
C linker for the host machine: cc ld.bfd 2.38
C++ compiler for the host machine: c++ (gcc 11.4.0 "c++ (Ubuntu 11.4.0-2ubuntu1~18.04) 11.4.0")
C++ linker for the host machine: c++ ld.bfd 2.38
Host machine cpu family: x86_64
Host machine cpu: x86_64
Message: OpenCL kernel path set to: nntrainer_opencl_kernels
Compiler for C supports arguments -Wredundant-decls: YES 
Compiler for C++ supports arguments -Wredundant-decls: YES 
Compiler for C supports arguments -Wwrite-strings: YES 
Compiler for C++ supports arguments -Wwrite-strings: YES 
Compiler for C supports arguments -Wformat: YES 
Compiler for C++ supports arguments -Wformat: YES 
Compiler for C supports arguments -Wformat-nonliteral: YES 
Compiler for C++ supports arguments -Wformat-nonliteral: YES 
Compiler for C supports arguments -Wformat-security: YES 
Compiler for C++ supports arguments -Wformat-security: YES 
Compiler for C supports arguments -Winit-self: YES 
Compiler for C++ supports arguments -Winit-self: YES 
Compiler for C supports arguments -Waddress: YES 
Compiler for C++ supports arguments -Waddress: YES 
Compiler for C supports arguments -Wvla: YES 
Compiler for C++ supports arguments -Wvla: YES 
Compiler for C supports arguments -Wpointer-arith: YES 
Compiler for C++ supports arguments -Wpointer-arith: YES 
Compiler for C supports arguments -Wno-error=varargs: YES 
Compiler for C++ supports arguments -Wno-error=varargs: YES 
Compiler for C supports arguments -Wdefaulted-function-deleted: NO 
Compiler for C++ supports arguments -Wdefaulted-function-deleted: NO 
Compiler for C supports arguments -ftree-vectorize: YES 
Compiler for C++ supports arguments -ftree-vectorize: YES 
Compiler for C supports arguments -Wno-maybe-uninitialized: YES 
Compiler for C++ supports arguments -Wno-maybe-uninitialized: YES 
Compiler for C supports arguments -Wno-unused-variable: YES 
Compiler for C++ supports arguments -Wno-unused-variable: YES 
Compiler for C supports arguments -Wmissing-declarations: YES 
Compiler for C supports arguments -Wmissing-include-dirs: YES 
Compiler for C supports arguments -Wmissing-prototypes: YES 
Compiler for C supports arguments -Wnested-externs: YES 
Compiler for C supports arguments -Waggregate-return: YES 
Compiler for C supports arguments -Wold-style-definition: YES 
Compiler for C supports arguments -Wdeclaration-after-statement: YES 
Compiler for C supports arguments -Wno-error=varargs: YES (cached)
WARNING: You should add the boolean check kwarg to the run_command call.
         It currently defaults to false,
         but it will default to true in future releases of meson.
         See also: https://github.com/mesonbuild/meson/issues/9300
Found pkg-config: /usr/bin/pkg-config (0.29.2)
Run-time dependency capi-ml-common found: YES 1.8.5
Run-time dependency capi-ml-inference found: YES 1.8.5
Run-time dependency openblas found: YES 0.3.20
Message: set nntrainer num threads=1
Run-time dependency OpenMP found: YES 4.5
Message: set nntrainer omp threads=1
Run-time dependency GMock found: YES 1.11.0
Run-time dependency GTest found: YES 1.11.0
Run-time dependency GTest found: YES 1.11.0
Library m found: YES
Library dl found: YES
Run-time dependency threads found: YES
Dependency iniparser found: NO found 3.2 but need: '>=4.1'
Found CMake: /usr/bin/cmake (3.22.1)
Run-time dependency iniparser found: NO (tried pkgconfig and cmake)
Message: falling back to find libiniparser library and header files
Library iniparser found: YES
Has header "iniparser.h" : YES 
Run-time dependency tensorflow2-lite found: YES 2.15.0
Run-time dependency opencv found: NO (tried pkgconfig and cmake)
Run-time dependency opencv4 found: YES 4.5.4
Program flatc found: YES (/usr/bin/flatc)
Configuring nntrainer.pc using configuration
Configuring nntrainer.ini using configuration
meson.build:404: WARNING: The variable(s) 'MEMORY_SWAP_LOOKAHEAD' in the input file 'nntrainer.ini.in' are not present in the given configuration data.
Message: NNTRAINER_CONF_PATH=/etc/nntrainer.ini
Message: extra defines are:-DMIN_CPP_VERSION=201703L -DOPENCL_KERNEL_PATH=nntrainer_opencl_kernels -DML_API_COMMON=1 -DNNSTREAMER_AVAILABLE=1 -DUSE_BLAS=1 -DNNTR_NUM_THREADS=1 -DOMP_NUM_THREADS=1 -D__LOGGING__=1 -DENABLE_TEST=1 -DREDUCE_TOLERANCE=1 -DENABLE_NNSTREAMER_BACKBONE=1 -DENABLE_TFLITE_BACKBONE=1 -DENABLE_TFLITE_INTERPRETER=1 -DENABLE_DATA_AUGMENTATION_OPENCV=1 -DNNTRAINER_CONF_PATH="/etc/nntrainer.ini"
Configuring ccapi-ml-training.pc using configuration
Configuring capi-ml-training.pc using configuration
Run-time dependency nnstreamer-test-devel found: NO (tried pkgconfig and cmake)
Run-time dependency jsoncpp found: YES 1.9.5
Run-time dependency libcurl found: YES 7.81.0
Run-time dependency nnstreamer found: YES 2.4.1
Message: building nnstreamer
Message: building nstreamer tensor_filter
Run-time dependency glib-2.0 found: YES 2.72.4
Run-time dependency gmodule-2.0 found: YES 2.72.4
Run-time dependency gstreamer-1.0 found: YES 1.20.3
Dependency glib-2.0 found: YES 2.72.4 (cached)
Dependency gmodule-2.0 found: YES 2.72.4 (cached)
Dependency gstreamer-1.0 found: YES 1.20.3 (cached)
Build targets in project: 78
NOTICE: Future-deprecated features used:
 * 0.56.0: {'meson.build_root', 'meson.source_root'}

nntrainer 0.5.0

  User defined options
    bindir                          : lib/nntrainer/bin
    buildtype                       : plain
    includedir                      : include
    libdir                          : lib/x86_64-linux-gnu
    prefix                          : /usr
    sysconfdir                      : /etc
    capi-ml-common-actual           : capi-ml-common
    capi-ml-inference-actual        : capi-ml-inference
    enable-capi                     : enabled
    enable-debug                    : false
    enable-nnstreamer-backbone      : true
    enable-nnstreamer-tensor-filter : enabled
    enable-nnstreamer-tensor-trainer: enabled
    install-app                     : true
    ml-api-support                  : enabled
    reduce-tolerance                : true

Found ninja-1.10.1 at /usr/bin/ninja
make[1]: Leaving directory '/home/udit/viproj/nntrainer'                                            
   debian/rules override_dh_auto_build
make[1]: Entering directory '/home/udit/viproj/nntrainer'
ninja -C build
ninja: Entering directory `build'
[1/479] Generating nntrainer/compiler/nntrainer-schema with a custom command
[2/479] Generating nntrainer/compiler/tflite-schema with a custom command
[3/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_flatbuffer_interpreter.cpp.o
[4/479] Compiling C++ object Applications/utils/jni/libapp_utils.so.p/bitmap_helpers.cpp.o
[5/479] Compiling C++ object Applications/utils/jni/libapp_utils.a.p/bitmap_helpers.cpp.o
[6/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_remap_realizer.cpp.o
[7/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_previous_input_realizer.cpp.o
[8/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_flatten_realizer.cpp.o
[9/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_activation_realizer.cpp.o
[10/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_slice_realizer.cpp.o
[11/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_multiout_realizer.cpp.o
[12/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_input_realizer.cpp.o
[13/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_bn_realizer.cpp.o
[14/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_data_iteration.cpp.o
[15/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_recurrent_realizer.cpp.o
[16/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_iteration_queue.cpp.o
[17/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_loss_realizer.cpp.o
[18/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_ini_interpreter.cpp.o
[19/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_tflite_opnode.cpp.o
[20/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_databuffer.cpp.o
[21/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_concat_layer.cpp.o
[22/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_databuffer_factory.cpp.o
[23/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_bn_layer.cpp.o
[24/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_compiler_tflite_interpreter.cpp.o
[25/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_random_data_producers.cpp.o
[26/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_func_data_producer.cpp.o
[27/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_raw_file_data_producer.cpp.o
[28/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_dataset_dir_data_producers.cpp.o
[29/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_loss_loss_layer.cpp.o
[30/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_loss_kld_loss_layer.cpp.o
[31/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_loss_mse_loss_layer.cpp.o
[32/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_loss_cross_entropy_sigmoid_loss_layer.cpp.o
[33/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_loss_cross_entropy_softmax_loss_layer.cpp.o
[34/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_loss_constant_derivative_loss_layer.cpp.o
[35/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_activation_layer.cpp.o
[36/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_addition_layer.cpp.o
[37/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_attention_layer.cpp.o
[38/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_layer_normalization_layer.cpp.o
[39/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_conv1d_layer.cpp.o
[40/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_flatten_layer.cpp.o
[41/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_mol_attention_layer.cpp.o
[42/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_multiout_layer.cpp.o
[43/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_fc_layer.cpp.o
[44/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_multi_head_attention_layer.cpp.o
[45/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_conv2d_layer.cpp.o
[46/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_input_layer.cpp.o
[47/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_preprocess_flip_layer.cpp.o
[48/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_preprocess_l2norm_layer.cpp.o
[49/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_preprocess_translate_layer.cpp.o
[50/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_pooling2d_layer.cpp.o
[51/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_embedding.cpp.o
[52/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_layer_node.cpp.o
[53/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_rnn.cpp.o
[54/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_rnncell.cpp.o
[55/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_lstm.cpp.o
[56/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_lstmcell.cpp.o
[57/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_lstmcell_core.cpp.o
[58/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_zoneout_lstmcell.cpp.o
[59/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_split_layer.cpp.o
[60/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_time_dist.cpp.o
[61/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_common_properties.cpp.o
[62/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_permute_layer.cpp.o
[63/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_layer_impl.cpp.o
[64/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_dropout.cpp.o
[65/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_centroid_knn.cpp.o
[66/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_layer_context.cpp.o
[67/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_reshape_layer.cpp.o
[68/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_grucell.cpp.o
[69/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_reduce_mean_layer.cpp.o
[70/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_gru.cpp.o
[71/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_identity_layer.cpp.o
[72/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_positional_encoding_layer.cpp.o
[73/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_optimizer_devel.cpp.o
[74/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_nnstreamer_layer.cpp.o
[75/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_optimizer_context.cpp.o
[76/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_sgd.cpp.o
[77/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_models_model_common_properties.cpp.o
[78/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_blas_interface.cpp.o
[79/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_models_dynamic_training_optimization.cpp.o
[80/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_adam.cpp.o
[81/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_cache_elem.cpp.o
[82/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_layers_tflite_layer.cpp.o
[83/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_cache_loader.cpp.o
[84/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_lr_scheduler_constant.cpp.o
[85/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_lr_scheduler_exponential.cpp.o
[86/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_lazy_tensor.cpp.o
[87/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_lr_scheduler_step.cpp.o
[88/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_tensor_base.cpp.o
[89/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_optimizers_optimizer_wrapped.cpp.o
[90/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_cache_pool.cpp.o
[91/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_basic_planner.cpp.o
[92/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_tensor_v2.cpp.o
[93/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_weight.cpp.o
[94/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_var_grad.cpp.o
[95/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_float_tensor.cpp.o
[96/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_models_model_loader.cpp.o
[97/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_swap_device.cpp.o
[98/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_optimized_v1_planner.cpp.o
[99/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_optimized_v2_planner.cpp.o
[100/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_memory_pool.cpp.o
[101/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_optimized_v3_planner.cpp.o
[102/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_tensor.cpp.o
[103/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_task_executor.cpp.o
[104/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_tensor_pool.cpp.o
[105/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_fp16.cpp.o
[106/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_util_simd.cpp.o
[107/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_tensor_dim.cpp.o
[108/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_tensor_manager.cpp.o
[109/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_models_neuralnet.cpp.o
[110/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_profiler.cpp.o
[111/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_graph_graph_core.cpp.o
[112/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_nntrainer_logger.cpp.o
[113/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_base_properties.cpp.o
[114/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_nntr_threads.cpp.o
[115/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_node_exporter.cpp.o
[116/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_ini_wrapper.cpp.o
[117/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_utils_util_func.cpp.o
[118/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_graph_connection.cpp.o
[119/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_remap_realizer.cpp.o
[120/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_flatten_realizer.cpp.o
[121/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_input_realizer.cpp.o
[122/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_slice_realizer.cpp.o
[123/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_bn_realizer.cpp.o
[124/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_activation_realizer.cpp.o
[125/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_graph_network_graph.cpp.o
[126/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_previous_input_realizer.cpp.o
[127/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_flatbuffer_interpreter.cpp.o
[128/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_dataset_iteration_queue.cpp.o
[129/479] Compiling C++ object test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o
FAILED: test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o 
c++ -Itest/unittest/layers/unittest_layers.p -Itest/unittest/layers -I../test/unittest/layers -Inntrainer -I../nntrainer -Iapi -I../api -I../api/ccapi/include -Inntrainer/compiler -I../nntrainer/compiler -Inntrainer/dataset -I../nntrainer/dataset -Inntrainer/layers/loss -I../nntrainer/layers/loss -Inntrainer/layers -I../nntrainer/layers -Inntrainer/models -I../nntrainer/models -Inntrainer/optimizers -I../nntrainer/optimizers -Inntrainer/tensor -I../nntrainer/tensor -Inntrainer/utils -I../nntrainer/utils -Inntrainer/graph -I../nntrainer/graph -I../test/include -I/usr/include/x86_64-linux-gnu/openblas-pthread/ -I/usr/include/iniparser -I/usr/include/nnstreamer -I/usr/include/tensorflow2/ -I/usr/include/opencv4 -fdiagnostics-color=always -D_FILE_OFFSET_BITS=64 -Wall -Winvalid-pch -Wnon-virtual-dtor -Werror -std=c++17 '-DVERSION="0.5.0"' -DVERSION_MAJOR=0 -DVERSION_MINOR=5 -DVERSION_MICRO=0 -Wredundant-decls -Wwrite-strings -Wformat -Wformat-nonliteral -Wformat-security -Winit-self -Waddress -Wvla -Wpointer-arith -Wno-error=varargs -ftree-vectorize -Wno-maybe-uninitialized -Wno-unused-variable -DMIN_CPP_VERSION=201703L -DOPENCL_KERNEL_PATH=nntrainer_opencl_kernels -DML_API_COMMON=1 -DNNSTREAMER_AVAILABLE=1 -DUSE_BLAS=1 -DNNTR_NUM_THREADS=1 -DOMP_NUM_THREADS=1 -D__LOGGING__=1 -DENABLE_TEST=1 -DREDUCE_TOLERANCE=1 -DENABLE_NNSTREAMER_BACKBONE=1 -DENABLE_TFLITE_BACKBONE=1 -DENABLE_TFLITE_INTERPRETER=1 -DENABLE_DATA_AUGMENTATION_OPENCV=1 '-DNNTRAINER_CONF_PATH="/etc/nntrainer.ini"' -g -O2 -ffile-prefix-map=/home/udit/viproj/nntrainer=. -flto=auto -ffat-lto-objects -flto=auto -ffat-lto-objects -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fopenmp -pthread -DGTEST_HAS_PTHREAD=1 -Wno-maybe-uninitialized -MD -MQ test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o -MF test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o.d -o test/unittest/layers/unittest_layers.p/unittest_layers_impl.cpp.o -c ../test/unittest/layers/unittest_layers_impl.cpp
../test/unittest/layers/unittest_layers_impl.cpp:58:49: error: ‘testing::Values’ is not a type
   58 | GTEST_PARAMETER_TEST(LayerImpl, LayerSemantics, ::testing::Values(semantic_tc));
      |                                                 ^~
../test/unittest/layers/unittest_layers_impl.cpp:58:80: error: expected constructor, destructor, or type conversion before ‘;’ token
   58 | GTEST_PARAMETER_TEST(LayerImpl, LayerSemantics, ::testing::Values(semantic_tc));
      |                                                                                ^
[130/479] Compiling C++ object nntrainer/libnntrainer.so.p/_home_udit_viproj_nntrainer_nntrainer_app_context.cpp.o
[131/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_multiout_realizer.cpp.o
[132/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_recurrent_realizer.cpp.o
[133/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_loss_realizer.cpp.o
[134/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_ini_interpreter.cpp.o
[135/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_tflite_opnode.cpp.o
[136/479] Compiling C++ object test/ccapi/unittest_ccapi.p/unittest_ccapi.cpp.o
[137/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_compiler_tflite_interpreter.cpp.o
[138/479] Compiling C++ object nntrainer/libnntrainer.a.p/_home_udit_viproj_nntrainer_nntrainer_dataset_databuffer.cpp.o
ninja: build stopped: subcommand failed.
make[1]: *** [debian/rules:50: override_dh_auto_build] Error 1
make[1]: Leaving directory '/home/udit/viproj/nntrainer'
make: *** [debian/rules:28: build] Error 2
dpkg-buildpackage: error: debian/rules build subprocess returned exit status 2
debuild: fatal error at line 1182:
dpkg-buildpackage -us -uc -ui failed

real    2m49.530s
user    13m46.209s
sys 0m31.249s
taos-ci commented 1 month ago

:octocat: cibot: Thank you for posting issue #2602. The person in charge will reply soon.

myungjoo commented 1 month ago

The log messages from your Ubuntu 22.04 machine is alarming:

C compiler for the host machine: cc (gcc 11.4.0 "cc (Ubuntu 11.4.0-2ubuntu1~18.04) 11.4.0")
C linker for the host machine: cc ld.bfd 2.38
C++ compiler for the host machine: c++ (gcc 11.4.0 "c++ (Ubuntu 11.4.0-2ubuntu1~18.04) 11.4.0")

You shouldn't see packages with "18.04" in your "22.04" machine.

Try things in a clean Ubuntu 22.04 machine (e.g., from a clean docker image).

Because the status of your machine is not stable or consistent, I recommend to try it in a clean docker or try to build it with pdebuild. Please refer to the build and test state (and the yaml scripts) of github-action; they are running and testing flawlessly in a clean Ubuntu 22.04/20.04 machines.

udit01 commented 1 month ago

Thank you so much. For this system, I upgraded from Ubuntu 18 to Ubuntu 22 using ubuntu's in-build upgrade manager. I guess it messed with the package versioning as you said. I tried it on a new Ubuntu 20 machine, and it installs!