search

kaldi-asr / kaldi

kaldi-asr/kaldi is the official location of the Kaldi project.
http://kaldi-asr.org
Other
14.27k stars 5.32k forks source link

make pybind11 #4253

Open fuyanzhe opened 4 years ago

fuyanzhe commented 4 years ago

g++ -std=c++11 -I.. -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/ceph/sz_ts80_new/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVE_CUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -I/ceph/sz_ts80_new/fyz/anaconda3/include/python3.7m -I/ceph/sz_ts80_new/fyz/anaconda3/lib/python3.7/site-packages/pybind11-2.5.dev1-py3.7.egg/pybind11/include -O3 -flto -I. -shared -o kaldi_pybind.cpython-37m-x86_64-linux-gnu.so chain/chain_den_graph_pybind.o chain/chain_pybind.o chain/chain_supervision_pybind.o chain/chain_training_pybind.o ctc/ctc_pybind.o cudamatrix/cu_device_pybind.o cudamatrix/cu_matrix_pybind.o cudamatrix/cu_vector_pybind.o cudamatrix/cudamatrix_pybind.o decoder/decodable_matrix_pybind.o decoder/decoder_pybind.o decoder/decoder_wrappers_pybind.o decoder/lattice_faster_decoder_pybind.o dlpack/dlpack_deleter.o dlpack/dlpack_pybind.o dlpack/dlpack_submatrix.o dlpack/dlpack_subvector.o feat/feat_pybind.o feat/feature_pybind.o feat/online_feature_pybind.o feat/wave_reader_pybind.o fst/arc_pybind.o fst/compile_pybind.o fst/fst_pybind.o fst/symbol_table_pybind.o fst/vector_fst_pybind.o fst/weight_pybind.o fstext/fstext_pybind.o fstext/kaldi_fst_io_pybind.o fstext/lattice_weight_pybind.o hmm/hmm_pybind.o hmm/hmm_topology_pybind.o hmm/transition_model_pybind.o itf/context_dep_itf_pybind.o itf/decodable_itf_pybind.o itf/itf_pybind.o itf/options_itf_pybind.o kaldi_pybind.o lat/determinize_lattice_pruned_pybind.o lat/kaldi_lattice_pybind.o lat/lat_pybind.o matrix/compressed_matrix_pybind.o matrix/kaldi_matrix_pybind.o matrix/kaldi_vector_pybind.o matrix/matrix_common_pybind.o matrix/matrix_pybind.o matrix/sparse_matrix_pybind.o nnet3/nnet3_pybind.o nnet3/nnet_chain_example_pybind.o nnet3/nnet_common_pybind.o nnet3/nnet_component_itf_pybind.o nnet3/nnet_convolutional_component_pybind.o nnet3/nnet_example_pybind.o nnet3/nnet_nnet_pybind.o nnet3/nnet_normalize_component_pybind.o nnet3/nnet_simple_component_pybind.o tests/test_dlpack_subvector.o util/kaldi_holder_pybind.o util/kaldi_io_pybind.o util/parse_options_pybind.o util/table_types_pybind.o util/util_pybind.o -Wl,--no-whole-archive -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib -rdynamic -flto -fuse-ld=gold -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../../tools/openfst/lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/ctc/warp-ctc/build ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib/libfst.so -L/ceph/sz_ts80_new/mkl/lib/intel64 -Wl,-rpath=/ceph/sz_ts80_new/mkl/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -ldl -lpthread -lm -lm -lpthread -ldl ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /usr/bin/ld.gold: error: ../chain/libkaldi-chain.so: symbol 'kaldi::CuDevice::this_threaddevice' used as both thread and non-thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here /usr/bin/ld.gold: error: ../cudamatrix/libkaldi-cudamatrix.so: symbol 'kaldi::CuDevice::this_threaddevice' used as both thread and non-thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here collect2: error: ld returned 1 exit status make: *** [kaldi_pybind.cpython-37m-x86_64-linux-gnu.so] Error 1

danpovey commented 4 years ago

We're not really supporting the pybind11 branch and IDK what would cause this error, I'm afraid.

On Wed, Sep 2, 2020 at 11:06 AM fuyanzhe notifications@github.com wrote:

g++ -std=c++11 -I.. -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/ceph/sz_ts80_new/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVE_CUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/include -I/ceph/sz_ts80_new/fyz/anaconda3/include/python3.7m -I/ceph/sz_ts80_new/fyz/anaconda3/lib/python3.7/site-packages/pybind11-2.5.dev1-py3.7.egg/pybind11/include -O3 -flto -I. -shared -o kaldi_pybind.cpython-37m-x86_64-linux-gnu.so chain/chain_den_graph_pybind.o chain/chain_pybind.o chain/chain_supervision_pybind.o chain/chain_training_pybind.o ctc/ctc_pybind.o cudamatrix/cu_device_pybind.o cudamatrix/cu_matrix_pybind.o cudamatrix/cu_vector_pybind.o cudamatrix/cudamatrix_pybind.o decoder/decodable_matrix_pybind.o decoder/decoder_pybind.o decoder/decoder_wrappers_pybind.o decoder/lattice_faster_decoder_pybind.o dlpack/dlpack_deleter.o dlpack/dlpack_pybind.o dlpack/dlpack_submatrix.o dlpack/dlpack_subvector.o feat/feat_pybind.o feat/feature_pybind.o feat/online_feature_pybind.o feat/wave_reader_pybind.o fst/arc_pybind.o fst/compile_pybind.o fst/fst_pybind.o fst/symbol_table_pybind.o fst/vector_fst_pybind.o fst/weight_pybind.o fstext/fstext_pybind.o fstext/kaldi_fst_io_pybind.o fstext/lattice_weight_pybind.o hmm/hmm_pybind.o hmm/hmm_topology_pybind.o hmm/transition_model_pybind.o itf/context_dep_itf_pybind.o itf/decodable_itf_pybind.o itf/itf_pybind.o itf/options_itf_pybind.o kaldi_pybind.o lat/determinize_lattice_pruned_pybind.o lat/kaldi_lattice_pybind.o lat/lat_pybind.o matrix/compressed_matrix_pybind.o matrix/kaldi_matrix_pybind.o matrix/kaldi_vector_pybind.o matrix/matrix_common_pybind.o matrix/matrix_pybind.o matrix/sparse_matrix_pybind.o nnet3/nnet3_pybind.o nnet3/nnet_chain_example_pybind.o nnet3/nnet_common_pybind.o nnet3/nnet_component_itf_pybind.o nnet3/nnet_convolutional_component_pybind.o nnet3/nnet_example_pybind.o nnet3/nnet_nnet_pybind.o nnet3/nnet_normalize_component_pybind.o nnet3/nnet_simple_component_pybind.o tests/test_dlpack_subvector.o util/kaldi_holder_pybind.o util/kaldi_io_pybind.o util/parse_options_pybind.o util/table_types_pybind.o util/util_pybind.o -Wl,--no-whole-archive -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib -rdynamic -flto -fuse-ld=gold -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/../../tools/openfst/lib -Wl,-rpath=/ceph/sz_ts80_new/fyz/kaldi/src/pybind/ctc/warp-ctc/build ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /ceph/sz_ts80_new/fyz/kaldi/tools/openfst-1.6.7/lib/libfst.so -L/ceph/sz_ts80_new/mkl/lib/intel64 -Wl,-rpath=/ceph/sz_ts80_new/mkl/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -ldl -lpthread -lm -lm -lpthread -ldl ../base/libkaldi-base.so ../chain/libkaldi-chain.so ../cudamatrix/libkaldi-cudamatrix.so ../decoder/libkaldi-decoder.so ../feat/libkaldi-feat.so ../fstext/libkaldi-fstext.so ../hmm/libkaldi-hmm.so ../lat/libkaldi-lat.so ../matrix/libkaldi-matrix.so ../nnet3/libkaldi-nnet3.so ../util/libkaldi-util.so ../../tools/openfst/lib/libfstscript.so ctc/warp-ctc/build/libwarpctc.so /usr/bin/ld.gold: error: ../chain/libkaldi-chain.so: symbol 'kaldi::CuDevice::this_threaddevice' used as both _thread and non-

thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here /usr/bin/ld.gold: error: ../cudamatrix/libkaldi-cudamatrix.so: symbol 'kaldi::CuDevice::this_thread_device' used as both thread and non-thread /usr/bin/ld.gold: chain/chain_den_graph_pybind.o: previous definition here collect2: error: ld returned 1 exit status make: *** [kaldi_pybind.cpython-37m-x86_64-linux-gnu.so] Error 1

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4253, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAZFLOZLQ6NIIJ554QE7HYDSDWZEJANCNFSM4QSQABFQ .

stale[bot] commented 4 years ago

This issue has been automatically marked as stale by a bot solely because it has not had recent activity. Please add any comment (simply 'ping' is enough) to prevent the issue from being closed for 60 more days if you believe it should be kept open.

cding-nv commented 3 years ago

The same error?

kaldi/src/pybind# g++ -c -std=c++11 -I.. -isystem /home/kaldi_/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/opt/intel/compilers_and_libraries_2020.0.166/linux/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVECUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /home/kaldi/kaldi/tools/openfst-1.6.7/include -I/opt/conda/include/python3.6m -I/root/.local/include/python3.6m -O3 -flto -I. -o chain/chain_den_graph_pybind.o chain/chain_den_graph_pybind.cc In file included from ./chain/chain_pybind.h:22:0, from chain/chain_den_graph_pybind.cc:18: ../pybind/kaldi_pybind.h:31:36: error: ‘overload_cast_impl’ in namespace ‘pybind11::detail’ does not name a template type using overloadcast = py::detail::overload_cast_impl; ^ In file included from chain/chain_den_graph_pybind.cc:21:0: ./fst/vector_fst_pybind.h: In function ‘void pybind_vector_fst_impl(pybind11::module&, const string&, const string&)’: ./fst/vector_fst_pybind.h:115:13: error: ‘overloadcast’ was not declared in this scope overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:40: error: expected primary-expression before ‘&’ token overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:41: error: expected primary-expression before ‘,’ token overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:43: error: expected primary-expression before ‘const’ overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:121:42: error: expected primary-expression before ‘const’ .def_static("Read", overloadcast<const fst::string&>()(&PyClass::Read),

danpovey commented 3 years ago

Probably has to do with newer version of pybind, if you can find the fix we'll merge it but we are not really working on that right now.

On Mon, Nov 23, 2020 at 11:00 AM ChrisD notifications@github.com wrote:

The same error?

kaldi/src/pybind# g++ -c -std=c++11 -I.. -isystem /home/kaldi_/kaldi/tools/openfst-1.6.7/include -O1 -Wno-sign-compare -Wall -Wno-sign-compare -Wno-unused-local-typedefs -Wno-deprecated-declarations -Winit-self -DKALDI_DOUBLEPRECISION=0 -DHAVE_EXECINFO_H=1 -DHAVE_CXXABI_H -DHAVE_MKL -I/opt/intel/compilers_and_libraries_2020.0.166/linux/mkl/include -m64 -msse -msse2 -pthread -g -fPIC -DHAVECUDA -I/usr/local/cuda/include -fPIC -pthread -isystem /home/kaldi/kaldi/tools/openfst-1.6.7/include -I/opt/conda/include/python3.6m -I/root/.local/include/python3.6m -O3 -flto -I. -o chain/chain_den_graph_pybind.o chain/chain_den_graph_pybind.cc In file included from ./chain/chain_pybind.h:22:0, from chain/chain_den_graph_pybind.cc:18: ../pybind/kaldi_pybind.h:31:36: error: ‘overload_cast_impl’ in namespace ‘pybind11::detail’ does not name a template type using overloadcast = py::detail::overload_cast_impl; ^ In file included from chain/chain_den_graph_pybind.cc:21:0: ./fst/vector_fst_pybind.h: In function ‘void pybind_vector_fst_impl(pybind11::module&, const string&, const string&)’: ./fst/vector_fst_pybind.h:115:13: error: ‘overloadcast’ was not declared in this scope overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:40: error: expected primary-expression before ‘&’ token overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:41: error: expected primary-expression before ‘,’ token overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:115:43: error: expected primary-expression before ‘const’ overloadcast<std::istream&, const fst::FstReadOptions&>()(&PyClass::Read), ^ ./fst/vector_fst_pybind.h:121:42: error: expected primary-expression before ‘const’ .def_static("Read", overloadcast<const fst::string&>()(&PyClass::Read),

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4253#issuecomment-731902487, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAZFLO4R6377AY5A2KDCJJDSRHF4TANCNFSM4QSQABFQ .

stale[bot] commented 3 years ago

This issue has been automatically marked as stale by a bot solely because it has not had recent activity. Please add any comment (simply 'ping' is enough) to prevent the issue from being closed for 60 more days if you believe it should be kept open.