search

tensordot / syntaxdot

Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.
Other
71 stars 3 forks source link

cannot use syntaxdot for symbol lookup error #220

Open tondach01 opened 2 years ago

tondach01 commented 2 years ago

Hello, I installed Syntaxdot as it was described in documentation, no error occurred, but when I tried to execute the syntaxdot binary, I got this error:

syntaxdot: symbol lookup error: syntaxdot: undefined symbol: _ZN2at3mulERKNS_6TensorERKN3c106ScalarE

I am using Ubuntu 22.04 on VirtualBox Thanks for your help, Ondra

danieldk commented 2 years ago

Could you give some more information, such as which libtorch archive you downloaded? Usually such errors come from downloading libtorch with the wrong C++ ABI.

(I should really provide pre-built CUDA binaries in the future.)

tondach01 commented 2 years ago

I downloaded libtorch from https://download.pytorch.org/libtorch/cu116/libtorch-cxx11-abi-shared-with-deps-1.12.1%2Bcu116.zip Stable (1.12.1) > Linux > LIbtorch > C++/Java > CUDA 11.6 > the second link (cxx11 ABI)

CUDA 11.7, rustup 1.24.3 (rustc 1.64.0), cmake 3.22.1, pkg-config 0.29.2, OpenSSL 3.0.2 15 Mar 2022, gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0

danieldk commented 2 years ago

Thanks! I’ll try and see if I can reproduce this.

danieldk commented 2 years ago

That's really odd, I installed Ubuntu 22.04 using distrobox and downloaded the same libtorch version as you did and it works fine. Could you show the ldd output for the syntaxdot binary. Here is mine:

% ldd target/release/syntaxdot
    linux-vdso.so.1 (0x00007ffd9fd67000)
    libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f8d744ff000)
    libtorch_cuda_cu.so => /home/daniel/syntaxdot-issue/libtorch/lib/libtorch_cuda_cu.so (0x00007f8d4be00000)
    libtorch_cuda_cpp.so => /home/daniel/syntaxdot-issue/libtorch/lib/libtorch_cuda_cpp.so (0x00007f8d39400000)
    libtorch_cpu.so => /home/daniel/syntaxdot-issue/libtorch/lib/libtorch_cpu.so (0x00007f8d20000000)
    libc10.so => /home/daniel/syntaxdot-issue/libtorch/lib/libc10.so (0x00007f8d1fc00000)
    libgomp.so.1 => /lib/x86_64-linux-gnu/libgomp.so.1 (0x00007f8d744b3000)
    libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f8d74493000)
    libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f8d1ff19000)
    libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f8d1f9d8000)
    /lib64/ld-linux-x86-64.so.2 (0x00007f8d74ca7000)
    libcudart-45da57e3.so.11.0 => /home/daniel/syntaxdot-issue/libtorch/lib/libcudart-45da57e3.so.11.0 (0x00007f8d1f600000)
    libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f8d7448e000)
    libc10_cuda.so => /home/daniel/syntaxdot-issue/libtorch/lib/libc10_cuda.so (0x00007f8d1f200000)
    libnvToolsExt-847d78f2.so.1 => /home/daniel/syntaxdot-issue/libtorch/lib/libnvToolsExt-847d78f2.so.1 (0x00007f8d1ee00000)
    libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f8d74487000)
    libcublas-2854e16e.so.11 => /home/daniel/syntaxdot-issue/libtorch/lib/libcublas-2854e16e.so.11 (0x00007f8d15600000)
    librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f8d74482000)
    libcudnn.so.8 => /home/daniel/syntaxdot-issue/libtorch/lib/libcudnn.so.8 (0x00007f8d15200000)
    libgomp-52f2fd74.so.1 => /home/daniel/syntaxdot-issue/libtorch/lib/libgomp-52f2fd74.so.1 (0x00007f8d14e00000)
    libcublasLt-b015978e.so.11 => /home/daniel/syntaxdot-issue/libtorch/lib/libcublasLt-b015978e.so.11 (0x00007f8cffc00000)
tondach01 commented 2 years ago

Hi, I ran the 'ldd' and there were some libraries missing e.g 'libtorch_cuda_cu.so'. So I tried to reboot the whole virtual machine, installed all the required programs, but this time I got an error right during compilation. I will sent the output log via e-mail, it is quite long.

tondach01 commented 2 years ago

Hi, this is the output from my last attempt to compile the syntaxdot binary.

Thaks a lot for your help

Ondra (tondach 01) ---------- Původní e-mail ---------- Od: Daniël de Kok @.> Komu: tensordot/syntaxdot @.> Kopie: tondach01 @.>, Author @. com> Datum: 8. 10. 2022 11:12:01 Předmět: Re: [tensordot/syntaxdot] cannot use syntaxdot for symbol lookup error (Issue #220) "

That's really odd, I installed Ubuntu 22.04 using distrobox and downloaded the same libtorch version as you did and it works fine. Could you show the ldd output for the syntaxdot binary. Here is mine:

% ldd target/release/syntaxdot linux-vdso.so.1 (0x00007ffd9fd67000) libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f8d744ff000) libtorch_cuda_cu.so => /home/daniel/syntaxdot-issue/libtorch/lib/libtorch_cuda_cu.so (0x00007f8d4be00000) libtorch_cuda_cpp.so => /home/daniel/syntaxdot-issue/libtorch/lib/libtorch_cuda_cpp.so (0x00007f8d39400000) libtorch_cpu.so => /home/daniel/syntaxdot-issue/libtorch/lib/libtorch_cpu.so (0x00007f8d20000000) libc10.so => /home/daniel/syntaxdot-issue/libtorch/lib/libc10.so (0x00007f8d1fc00000) libgomp.so.1 => /lib/x86_64-linux-gnu/libgomp.so.1 (0x00007f8d744b3000) libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f8d74493000) libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f8d1ff19000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f8d1f9d8000) /lib64/ld-linux-x86-64.so.2 (0x00007f8d74ca7000) libcudart-45da57e3.so.11.0 => /home/daniel/syntaxdot-issue/libtorch/lib/libcudart-45da57e3.so.11.0 (0x00007f8d1f600000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f8d7448e000) libc10_cuda.so => /home/daniel/syntaxdot-issue/libtorch/lib/libc10_cuda.so (0x00007f8d1f200000) libnvToolsExt-847d78f2.so.1 => /home/daniel/syntaxdot-issue/libtorch/lib/libnvToolsExt-847d78f2.so.1 (0x00007f8d1ee00000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f8d74487000) libcublas-2854e16e.so.11 => /home/daniel/syntaxdot-issue/libtorch/lib/libcublas-2854e16e.so.11 (0x00007f8d15600000) librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f8d74482000) libcudnn.so.8 => /home/daniel/syntaxdot-issue/libtorch/lib/libcudnn.so.8 (0x00007f8d15200000) libgomp-52f2fd74.so.1 => /home/daniel/syntaxdot-issue/libtorch/lib/libgomp-52f2fd74.so.1 (0x00007f8d14e00000) libcublasLt-b015978e.so.11 => /home/daniel/syntaxdot-issue/libtorch/lib/libcublasLt-b015978e.so.11 (0x00007f8cffc00000)

— Reply to this email directly, view it on GitHub (https://github.com/tensordot/syntaxdot/issues/220#issuecomment-1272273768), or unsubscribe (https://github.com/notifications/unsubscribe-auth/ATSJUY7S4S4GIPPEOXVNM4LWCE3F3ANCNFSM6AAAAAAQW4W2RM) . You are receiving this because you authored the thread. Message ID: < @.> " @.:~$ cargo install syntaxdot-cli Updating crates.io index Downloaded syntaxdot-cli v0.4.1 Downloaded 1 crate (32.8 KB) in 1.26s Installing syntaxdot-cli v0.4.1 Downloaded linked-hash-map v0.5.6 Downloaded num-integer v0.1.45 Downloaded number_prefix v0.4.0 Downloaded cmake v0.1.48 Downloaded anyhow v1.0.65 Downloaded indicatif v0.16.2 Downloaded strsim v0.8.0 Downloaded num-derive v0.3.3 Downloaded terminal_size v0.1.17 Downloaded num-complex v0.4.2 Downloaded env_logger v0.8.4 Downloaded vec_map v0.8.2 Downloaded yaml-rust v0.4.5 Downloaded bytecount v0.6.3 Downloaded textwrap v0.11.0 Downloaded prost-derive v0.8.0 Downloaded humantime v2.1.0 Downloaded matrixmultiply v0.3.2 Downloaded serde_yaml v0.8.26 Downloaded thiserror v1.0.37 Downloaded clap v2.34.0 Downloaded termcolor v1.1.3 Downloaded petgraph v0.6.2 Downloaded curl v0.4.44 Downloaded prost v0.9.0 Downloaded rawpointer v0.2.1 Downloaded prost v0.8.0 Downloaded maplit v1.0.2 Downloaded prost-derive v0.9.0 Downloaded ordered-float v2.10.0 Downloaded zip v0.5.13 Downloaded numberer v0.2.1 Downloaded fixedbitset v0.4.2 Downloaded bzip2 v0.4.3 Downloaded rand_xorshift v0.3.0 Downloaded crossbeam-channel v0.5.6 Downloaded crc32fast v1.3.2 Downloaded hashbrown v0.12.3 Downloaded match_cfg v0.1.0 Downloaded miniz_oxide v0.5.4 Downloaded quote v1.0.21 Downloaded ppv-lite86 v0.2.16 Downloaded pkg-config v0.3.25 Downloaded rand_core v0.6.4 Downloaded serde v1.0.145 Downloaded ryu v1.0.11 Downloaded socket2 v0.4.7 Downloaded rayon v1.5.3 Downloaded openssl-sys v0.9.76 Downloaded num_cpus v1.13.1 Downloaded memoffset v0.6.5 Downloaded lazy_static v1.4.0 Downloaded hostname v0.3.1 Downloaded either v1.8.0 Downloaded syn v1.0.102 Downloaded cfg-if v1.0.0 Downloaded bytes v1.2.1 Downloaded openssl-probe v0.1.5 Downloaded num-traits v0.2.15 Downloaded tinyvec_macros v0.1.0 Downloaded unicode-ident v1.0.5 Downloaded unicode-width v0.1.10 Downloaded unicode-normalization v0.1.22 Downloaded indexmap v1.9.1 Downloaded proc-macro2 v1.0.46 Downloaded itoa v1.0.4 Downloaded half v1.8.2 Downloaded toml v0.5.9 Downloaded thiserror-impl v1.0.37 Downloaded serde_json v1.0.86 Downloaded atty v0.2.14 Downloaded rand_chacha v0.3.1 Downloaded serde_derive v1.0.145 Downloaded adler v1.0.2 Downloaded crossbeam-deque v0.8.2 Downloaded byteorder v1.4.3 Downloaded ndarray v0.15.6 Downloaded memchr v2.5.0 Downloaded crossbeam-epoch v0.9.11 Downloaded bzip2-sys v0.1.11+1.0.8 Downloaded seqalign v0.2.3 Downloaded wordpieces v0.5.0 Downloaded udgraph v0.7.0 Downloaded syntaxdot-tokenizers v0.4.0 Downloaded stdinout v0.4.1 Downloaded syntaxdot-tch-ext v0.4.0 Downloaded syntaxdot-summary v0.4.0 Downloaded syntaxdot-transformers v0.4.0 Downloaded ohnomore v0.4.0 Downloaded caseless v0.2.1 Downloaded regex-syntax v0.6.27 Downloaded syntaxdot v0.4.1 Downloaded conllu v0.7.0 Downloaded flate2 v1.0.24 Downloaded aho-corasick v0.7.19 Downloaded sentencepiece v0.8.2 Downloaded rayon-core v1.9.3 Downloaded torch-sys v0.5.0 Downloaded syntaxdot-encoders v0.4.0 Downloaded libc v0.2.134 Downloaded rand v0.8.5 Downloaded itertools v0.10.5 Downloaded tinyvec v1.6.0 Downloaded time v0.1.44 Downloaded tch v0.5.0 Downloaded threadpool v1.8.1 Downloaded scopeguard v1.1.0 Downloaded log v0.4.17 Downloaded cc v1.0.73 Downloaded libz-sys v1.1.8 Downloaded sentencepiece-sys v0.8.3 Downloaded fst v0.4.7 Downloaded curl-sys v0.4.56+curl-7.83.1 Downloaded crossbeam-utils v0.8.12 Downloaded ansi_term v0.12.1 Downloaded bitflags v1.3.2 Downloaded regex v1.6.0 Downloaded getrandom v0.2.7 Downloaded console v0.15.2 Downloaded autocfg v1.1.0 Downloaded 120 crates (16.4 MB) in 4.54s (largest was curl-sys at 3.0 MB) Compiling autocfg v1.1.0 Compiling libc v0.2.134 Compiling proc-macro2 v1.0.46 Compiling quote v1.0.21 Compiling unicode-ident v1.0.5 Compiling syn v1.0.102 Compiling cc v1.0.73 Compiling pkg-config v0.3.25 Compiling cfg-if v1.0.0 Compiling thiserror v1.0.37 Compiling anyhow v1.0.65 Compiling memchr v2.5.0 Compiling crc32fast v1.3.2 Compiling serde_derive v1.0.145 Compiling adler v1.0.2 Compiling serde v1.0.145 Compiling hashbrown v0.12.3 Compiling curl v0.4.44 Compiling either v1.8.0 Compiling openssl-probe v0.1.5 Compiling byteorder v1.4.3 Compiling lazy_static v1.4.0 Compiling rawpointer v0.2.1 Compiling fst v0.4.7 Compiling fixedbitset v0.4.2 Compiling regex-syntax v0.6.27 Compiling crossbeam-utils v0.8.12 Compiling bytes v1.2.1 Compiling tinyvec_macros v0.1.0 Compiling ppv-lite86 v0.2.16 Compiling scopeguard v1.1.0 Compiling half v1.8.2 Compiling log v0.4.17 Compiling rayon-core v1.9.3 Compiling serde_json v1.0.86 Compiling ryu v1.0.11 Compiling maplit v1.0.2 Compiling seqalign v0.2.3 Compiling linked-hash-map v0.5.6 Compiling itoa v1.0.4 Compiling syntaxdot-summary v0.4.0 Compiling unicode-width v0.1.10 Compiling match_cfg v0.1.0 Compiling number_prefix v0.4.0 Compiling humantime v2.1.0 Compiling ansi_term v0.12.1 Compiling vec_map v0.8.2 Compiling termcolor v1.1.3 Compiling bitflags v1.3.2 Compiling strsim v0.8.0 Compiling stdinout v0.4.1 Compiling bytecount v0.6.3 Compiling num-traits v0.2.15 Compiling indexmap v1.9.1 Compiling num-integer v0.1.45 Compiling memoffset v0.6.5 Compiling crossbeam-epoch v0.9.11 Compiling rayon v1.5.3 Compiling cmake v0.1.48 Compiling bzip2-sys v0.1.11+1.0.8 Compiling libz-sys v1.1.8 Compiling openssl-sys v0.9.76 Compiling curl-sys v0.4.56+curl-7.83.1 Compiling miniz_oxide v0.5.4 Compiling itertools v0.10.5 Compiling matrixmultiply v0.3.2 Compiling tinyvec v1.6.0 Compiling yaml-rust v0.4.5 Compiling textwrap v0.11.0 Compiling sentencepiece-sys v0.8.3 Compiling unicode-normalization v0.1.22 Compiling getrandom v0.2.7 Compiling time v0.1.44 Compiling num_cpus v1.13.1 Compiling atty v0.2.14 Compiling terminal_size v0.1.17 Compiling hostname v0.3.1 Compiling socket2 v0.4.7 Compiling aho-corasick v0.7.19 Compiling flate2 v1.0.24 Compiling crossbeam-channel v0.5.6 Compiling num-complex v0.4.2 Compiling petgraph v0.6.2 Compiling rand_core v0.6.4 Compiling threadpool v1.8.1 Compiling clap v2.34.0 Compiling console v0.15.2 Compiling bzip2 v0.4.3 Compiling regex v1.6.0 Compiling ndarray v0.15.6 Compiling udgraph v0.7.0 Compiling crossbeam-deque v0.8.2 Compiling rand_chacha v0.3.1 Compiling rand_xorshift v0.3.0 Compiling thiserror-impl v1.0.37 Compiling prost-derive v0.9.0 Compiling num-derive v0.3.3 Compiling prost-derive v0.8.0 Compiling caseless v0.2.1 Compiling env_logger v0.8.4 Compiling indicatif v0.16.2 Compiling rand v0.8.5 Compiling prost v0.9.0 Compiling prost v0.8.0 Compiling zip v0.5.13 Compiling wordpieces v0.5.0 Compiling conllu v0.7.0 Compiling numberer v0.2.1 Compiling ordered-float v2.10.0 Compiling toml v0.5.9 Compiling serde_yaml v0.8.26 Compiling sentencepiece v0.8.2 Compiling torch-sys v0.5.0 Compiling syntaxdot-tokenizers v0.4.0 Compiling ohnomore v0.4.0 The following warnings were emitted during compilation:

warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api.cpp: In function ‘torch::jit::script::Module atm_create_for_tracing(char, at::Tensor, int)’: warning: libtch/torch_api.cpp:937:21: error: ‘torch::jit::tracer’ has not been declared warning: 937 | if (torch::jit::tracer::isTracing()) warning: | ^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api.cpp:939:47: error: ‘tracer’ is not a member of ‘torch::jit’; did you mean ‘at::tracer’? warning: 939 | auto state = std::make_shared(); warning: | ^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:62, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/TracerMode.h:113:11: note: ‘at::tracer’ declared here warning: 113 | namespace tracer { warning: | ^~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api.cpp:939:47: error: ‘tracer’ is not a member of ‘torch::jit’; did you mean ‘at::tracer’? warning: 939 | auto state = std::make_shared(); warning: | ^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:62, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/TracerMode.h:113:11: note: ‘at::tracer’ declared here warning: 113 | namespace tracer { warning: | ^~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api.cpp:939:23: error: parse error in template argument list warning: 939 | auto state = std::make_shared(); warning: | ^~~~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api.cpp:939:68: error: no matching function for call to ‘make_shared< >()’ warning: 939 | auto state = std::make_shared(); warning: | ~~~~~~~~~~^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /usr/include/c++/11/memory:77, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/c10/util/C++17.h:8, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/c10/util/string_view.h:4, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/c10/util/StringUtil.h:6, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/c10/util/Exception.h:6, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/c10/core/Device.h:5, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/core/TensorBody.h:11, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/core/Tensor.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Tensor.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:6, warning: from libtch/torch_api.cpp:1: warning: /usr/include/c++/11/bits/shared_ptr.h:875:5: note: candidate: ‘template<class _Tp, class ... _Args> std::shared_ptr<_Tp> std::make_shared(_Args&& ...)’ warning: 875 | make_shared(_Args&&... args) warning: | ^~~ warning: /usr/include/c++/11/bits/shared_ptr.h:875:5: note: template argument deduction/substitution failed: warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api.cpp:939:68: error: template argument 1 is invalid warning: 939 | auto state = std::make_shared(); warning: | ~~~~~~~~~~^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api.cpp:940:17: error: ‘torch::jit::tracer’ has not been declared warning: 940 | torch::jit::tracer::setTracingState(state); warning: | ^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api.cpp:949:15: error: ‘torch::jit::tracer’ has not been declared warning: 949 | torch::jit::tracer::abandon(); warning: | ^~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api.cpp: In function ‘void atm_end_tracing(module, char*, at::Tensor**, int)’: warning: libtch/torch_api.cpp:955:30: error: ‘torch::jit::tracer’ has not been declared warning: 955 | auto state = torch::jit::tracer::getTracingState(); warning: | ^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api.cpp:963:17: error: ‘torch::jit::tracer’ has not been declared warning: 963 | torch::jit::tracer::setTracingState(nullptr); warning: | ^~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgbaddbmmmkl(at::Tensor*, tensor, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:224:29: error: ‘_baddbmmmkl’ is not a member of ‘torch’ warning: 224 | auto outputs__ = torch::_baddbmmmkl(self, batch1, batch2); warning: | ^~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg__bmm(at::Tensor, tensor, tensor, int)’: warning: libtch/torch_api_generated.cpp.h:231:29: error: ‘_bmm’ is not a member of ‘torch’ warning: 231 | auto outputs = torch::_bmm(self, mat2, (bool)deterministic); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgbmm_out(at::Tensor, tensor, tensor, tensor, int)’: warning: libtch/torch_api_generated.cpp.h:238:29: error: ‘_bmm_out’ is not a member of ‘torch’ warning: 238 | auto outputs = torch::_bmm_out(out, self, mat2, (bool)deterministic); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgcat(at::Tensor, at::Tensor, int, int64_t)’: warning: libtch/torch_api_generated.cpp.h:301:29: error: ‘_cat’ is not a member of ‘torch’ warning: 301 | auto outputs = torch::_cat(of_carray_tensor(tensors_data, tensors_len), dim); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgcat_out(at::Tensor, tensor, at::Tensor, int, int64_t)’: warning: libtch/torch_api_generated.cpp.h:308:29: error: ‘_cat_out’ is not a member of ‘torch’ warning: 308 | auto outputs = torch::_cat_out(out, of_carray_tensor(tensors_data, tensors_len), dim); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgconvolution_nogroup(at::Tensor, tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:385:29: error: ‘_convolution_nogroup’ is not a member of ‘torch’ warning: 385 | auto outputs = torch::_convolution_nogroup(input, weight, (bias ? *bias : torch::Tensor()), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(dilation_data, dilation_len), (bool)transposed, torch::IntArrayRef(output_padding_data, output_padding_len)); warning: | ^~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgcumprod(at::Tensor**, tensor, int64_t)’: warning: libtch/torch_api_generated.cpp.h:461:29: error: ‘_cumprod’ is not a member of ‘torch’ warning: 461 | auto outputs = torch::_cumprod(*self, dim); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgcumprod_out(at::Tensor**, tensor, tensor, int64_t)’: warning: libtch/torch_api_generated.cpp.h:468:29: error: ‘_cumprod_out’ is not a member of ‘torch’ warning: 468 | auto outputs = torch::_cumprod_out(out, self, dim); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgcumsum(at::Tensor, tensor, int64_t)’: warning: libtch/torch_api_generated.cpp.h:475:29: error: ‘_cumsum’ is not a member of ‘torch’ warning: 475 | auto outputs = torch::_cumsum(*self, dim); warning: | ^~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgcumsum_out(at::Tensor, tensor, tensor, int64_t)’: warning: libtch/torch_api_generated.cpp.h:482:29: error: ‘_cumsum_out’ is not a member of ‘torch’ warning: 482 | auto outputs__ = torch::_cumsum_out(out, self, dim); warning: | ^~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg__indexcopy(at::Tensor, tensor, int64_t, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:711:29: error: ‘_indexcopy’ is not a member of ‘torch’ warning: 711 | auto outputs = torch::_indexcopy(self, dim, index, *source); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atginverse_helper(at::Tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:732:29: error: ‘_inverse_helper’ is not a member of ‘torch’ warning: 732 | auto outputs = torch::_inverse_helper(*self); warning: | ^~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg__linalg_solve_outhelper(at::Tensor**, tensor, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:754:29: error: ‘_linalg_solve_outhelper’ is not a member of ‘torch’ warning: 754 | auto outputs = torch::_linalg_solve_outhelper(self, other, *infos); warning: | ^~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atglog_softmax_backward_data(at::Tensor**, tensor, tensor, int64_t, tensor)’: warning: libtch/torch_api_generated.cpp.h:768:84: error: cannot convert ‘at::Tensor’ to ‘c10::ScalarType’ warning: 768 | auto outputs = torch::_log_softmax_backward_data(grad_output, output, dim, *self); warning: | ^~~~~ warning: | | warning: | at::Tensor warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:217, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/_log_softmax_backward_data.h:26:143: note: initializing argument 4 of ‘at::Tensor at::_log_softmax_backward_data(const at::Tensor&, const at::Tensor&, int64_t, c10::ScalarType)’ warning: 26 | TORCH_API inline at::Tensor _log_softmax_backward_data(const at::Tensor & grad_output, const at::Tensor & output, int64_t dim, at::ScalarType input_dtype) { warning: | ~~~^~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atgnnpack_spatial_convolution_backward_input(at::Tensor*, tensor, tensor, tensor, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:861:29: error: ‘_nnpack_spatial_convolution_backward_input’ is not a member of ‘torch’ warning: 861 | auto outputs = torch::_nnpack_spatial_convolution_backward_input(input, grad_output, *weight, torch::IntArrayRef(padding_data, padding_len)); warning: | ^~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgnnpack_spatial_convolution_backward_weight(at::Tensor*, tensor, int64_t, int, tensor, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:868:29: error: ‘_nnpack_spatial_convolution_backward_weight’ is not a member of ‘torch’ warning: 868 | auto outputs__ = torch::_nnpack_spatial_convolution_backward_weight(input, torch::IntArrayRef(weightsize_data, weightsize_len), *grad_output, torch::IntArrayRef(padding_data, padding_len)); warning: | ^~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgs_where(at::Tensor, tensor, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:934:29: error: ‘_s_where’ is not a member of ‘torch’ warning: 934 | auto outputs = torch::_s_where(condition, self, *other); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg__softmax_backward_data(at::Tensor**, tensor, tensor, int64_t, tensor)’: warning: libtch/torch_api_generated.cpp.h:998:80: error: cannot convert ‘at::Tensor’ to ‘c10::ScalarType’ warning: 998 | auto outputs = torch::_softmax_backward_data(grad_output, output, dim, *self); warning: | ^~~~~ warning: | | warning: | at::Tensor warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:272, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/_softmax_backward_data.h:26:139: note: initializing argument 4 of ‘at::Tensor at::_softmax_backward_data(const at::Tensor&, const at::Tensor&, int64_t, c10::ScalarType)’ warning: 26 | TORCH_API inline at::Tensor _softmax_backward_data(const at::Tensor & grad_output, const at::Tensor & output, int64_t dim, at::ScalarType input_dtype) { warning: | ~~~^~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg__solve_helper(at::Tensor, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:1005:29: error: ‘_solve_helper’ is not a member of ‘torch’ warning: 1005 | auto outputs = torch::_solve_helper(self, A); warning: | ^~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg__sparse_csr_tensor(at::Tensor**, tensor, tensor, tensor, int, int)’: warning: libtch/torch_api_generated.cpp.h:1041:29: error: ‘_sparse_csr_tensor’ is not a member of ‘torch’; did you mean ‘sparse_csr_tensor’? warning: 1041 | auto outputs = torch::_sparse_csr_tensor(crow_indices, col_indices, *values, at::device(device_of_int(options_device)).dtype(at::ScalarType(options_kind))); warning: | ^~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgsparse_csr_tensor_crow_col_value_size(at::Tensor*, tensor, tensor, tensor, int64_t, int, int, int)’: warning: libtch/torch_api_generated.cpp.h:1048:29: error: ‘_sparse_csr_tensor’ is not a member of ‘torch’; did you mean ‘sparse_csr_tensor’? warning: 1048 | auto outputs = torch::_sparse_csr_tensor(crow_indices, col_indices, *values, torch::IntArrayRef(size_data, size_len), at::device(device_of_int(options_device)).dtype(at::ScalarType(options_kind))); warning: | ^~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgsvd_helper(at::Tensor*, tensor, int, int)’: warning: libtch/torch_api_generated.cpp.h:1181:29: error: ‘_svd_helper’ is not a member of ‘torch’ warning: 1181 | auto outputs__ = torch::_svd_helper(self, (bool)some, (bool)compute_uv); warning: | ^~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgweight_norm_cuda_interface(at::Tensor**, tensor, tensor, int64_t)’: warning: libtch/torch_api_generated.cpp.h:1321:29: error: ‘_weight_norm_cuda_interface’ is not a member of ‘torch’ warning: 1321 | auto outputs = torch::_weight_norm_cuda_interface(v, g, dim); warning: | ^~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atgweight_norm_cuda_interface_backward(at::Tensor, tensor, tensor, tensor, tensor, int64_t)’: warning: libtch/torch_api_generated.cpp.h:1329:29: error: ‘_weight_norm_cuda_interface_backward’ is not a member of ‘torch’ warning: 1329 | auto outputs__ = torch::_weight_norm_cuda_interface_backward(grad_w, saved_v, saved_g, saved_norms, dim); warning: | ^~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_bernoulli_out(at::Tensor, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:2410:42: error: call of overloaded ‘bernoulli_out(at::Tensor&, at::Tensor&)’ is ambiguous warning: 2410 | auto outputs = torch::bernoulli_out(out, self); warning: | ~~~~^~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:423, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/bernoulli.h:31:31: note: candidate: ‘at::Tensor& at::bernoulli_out(at::Tensor&, const at::Tensor&, c10::optional)’ warning: 31 | TORCH_API inline at::Tensor & bernoulli_out(at::Tensor & out, const at::Tensor & self, c10::optional generator=c10::nullopt) { warning: | ^~~~~ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:423, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/bernoulli.h:61:31: note: candidate: ‘at::Tensor& at::bernoulli_out(at::Tensor&, const at::Tensor&, double, c10::optional)’ warning: 61 | TORCH_API inline at::Tensor & bernoulli_out(at::Tensor & out, const at::Tensor & self, double p=0.5, c10::optional generator=c10::nullopt) { warning: | ^~~~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_conj_out(at::Tensor**, tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:3123:29: error: ‘conj_out’ is not a member of ‘torch’ warning: 3123 | auto outputs = torch::conj_out(out, self); warning: | ^~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_conv_depthwise3d_backward(at::Tensor, tensor, tensor, tensor, tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:3193:29: error: ‘conv_depthwise3d_backward_out’ is not a member of ‘torch’ warning: 3193 | auto outputs__ = torch::conv_depthwise3d_backward_out(grad_input, grad_weight, grad_bias, grad_output, self, weight, torch::IntArrayRef(kernel_size_data, kernel_size_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(dilation_data, dilation_len)); warning: | ^~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_backward_input(at::Tensor, int64_t, int, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int, int)’: warning: libtch/torch_api_generated.cpp.h:3461:29: error: ‘cudnn_convolution_backward_input’ is not a member of ‘torch’ warning: 3461 | auto outputs = torch::cudnn_convolution_backward_input(torch::IntArrayRef(self_size_data, self_size_len), grad_output, weight, torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic, (bool)allow_tf32); warning: | ^~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_backward_weight(at::Tensor*, int64_t, int, tensor, tensor, int64_t, int, int64_t, int, int64_t*, int, int64_t, int, int, int)’: warning: libtch/torch_api_generated.cpp.h:3468:29: error: ‘cudnn_convolution_backward_weight’ is not a member of ‘torch’ warning: 3468 | auto outputs = torch::cudnn_convolution_backward_weight(torch::IntArrayRef(weight_size_data, weight_size_len), grad_output, self, torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic, (bool)allow_tf32); warning: | ^~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_deprecated(at::Tensor, tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int)’: warning: libtch/torch_api_generated.cpp.h:3475:69: error: could not convert ‘((bias != 0) ? at::Tensor(((const at::Tensor)bias)) : at::Tensor())’ from ‘at::Tensor’ to ‘at::IntArrayRef’ {aka ‘c10::ArrayRef’} warning: 3475 | auto outputs__ = torch::cudnn_convolution(self, weight, (bias ? bias : torch::Tensor()), torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic); warning: | ~~^~~~~~ warning: | | warning: | at::Tensor warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_deprecated2(at::Tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int)’: warning: libtch/torch_api_generated.cpp.h:3482:46: error: too few arguments to function ‘at::Tensor at::cudnn_convolution(const at::Tensor&, const at::Tensor&, at::IntArrayRef, at::IntArrayRef, at::IntArrayRef, int64_t, bool, bool, bool)’ warning: 3482 | auto outputs__ = torch::cudnn_convolution(self, *weight, torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic); warning: | ~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:510, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/cudnn_convolution.h:26:29: note: declared here warning: 26 | TORCH_API inline at::Tensor cudnn_convolution(const at::Tensor & self, const at::Tensor & weight, at::IntArrayRef padding, at::IntArrayRef stride, at::IntArrayRef dilation, int64_t groups, bool benchmark, bool deterministic, bool allow_tf32) { warning: | ^~~~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_transpose_backward_input(at::Tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int, int)’: warning: libtch/torch_api_generated.cpp.h:3503:29: error: ‘cudnn_convolution_transpose_backward_input’ is not a member of ‘torch’ warning: 3503 | auto outputs__ = torch::cudnn_convolution_transpose_backward_input(grad_output, *weight, torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic, (bool)allow_tf32); warning: | ^~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_transpose_backward_weight(at::Tensor, int64_t, int, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int, int)’: warning: libtch/torch_api_generated.cpp.h:3510:29: error: ‘cudnn_convolution_transpose_backward_weight’ is not a member of ‘torch’ warning: 3510 | auto outputs__ = torch::cudnn_convolution_transpose_backward_weight(torch::IntArrayRef(weight_size_data, weight_size_len), grad_output, self, torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic, (bool)allow_tf32); warning: | ^~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_transpose_deprecated(at::Tensor, tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int)’: warning: libtch/torch_api_generated.cpp.h:3517:79: error: could not convert ‘((bias != 0) ? at::Tensor(((const at::Tensor)bias)) : at::Tensor())’ from ‘at::Tensor’ to ‘at::IntArrayRef’ {aka ‘c10::ArrayRef’} warning: 3517 | auto outputs__ = torch::cudnn_convolution_transpose(self, weight, (bias ? *bias : torch::Tensor()), torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(output_padding_data, output_padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic); warning: | ~~^~~~~~ warning: | | warning: | at::Tensor warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_cudnn_convolution_transpose_deprecated2(at::Tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int64_t, int, int)’: warning: libtch/torch_api_generated.cpp.h:3524:56: error: too few arguments to function ‘at::Tensor at::cudnn_convolution_transpose(const at::Tensor&, const at::Tensor&, at::IntArrayRef, at::IntArrayRef, at::IntArrayRef, at::IntArrayRef, int64_t, bool, bool, bool)’ warning: 3524 | auto outputs = torch::cudnn_convolution_transpose(self, weight, torch::IntArrayRef(padding_data, padding_len), torch::IntArrayRef(output_padding_data, output_padding_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(dilation_data, dilation_len), groups, (bool)benchmark, (bool)deterministic); warning: | ~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:513, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/cudnn_convolution_transpose.h:26:29: note: declared here warning: 26 | TORCH_API inline at::Tensor cudnn_convolution_transpose(const at::Tensor & self, const at::Tensor & weight, at::IntArrayRef padding, at::IntArrayRef output_padding, at::IntArrayRef stride, at::IntArrayRef dilation, int64_t groups, bool benchmark, bool deterministic, bool allow_tf32) { warning: | ^~~~~~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_grid_sampler_2d_backward(at::Tensor, tensor, tensor, tensor, int64_t, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:5413:53: error: too few arguments to function ‘std::tuple<at::Tensor, at::Tensor> at::grid_sampler_2d_backward(const at::Tensor&, const at::Tensor&, const at::Tensor&, int64_t, int64_t, bool, std::array<bool, 2>)’ warning: 5413 | auto outputs = torch::grid_sampler_2d_backward(grad_output, input, *grid, interpolation_mode, padding_mode, (bool)align_corners); warning: | ~~~~~~~^~~~~~~~~~~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:655, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/grid_sampler_2d_backward.h:26:54: note: declared here warning: 26 | TORCH_API inline ::std::tuple<at::Tensor,at::Tensor> grid_sampler_2d_backward(const at::Tensor & grad_output, const at::Tensor & input, const at::Tensor & grid, int64_t interpolation_mode, int64_t padding_mode, bool align_corners, ::std::array<bool,2> output_mask) { warning: | ^~~~~~~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_grid_sampler_3d_backward(at::Tensor**, tensor, tensor, tensor, int64_t, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:5428:53: error: too few arguments to function ‘std::tuple<at::Tensor, at::Tensor> at::grid_sampler_3d_backward(const at::Tensor&, const at::Tensor&, const at::Tensor&, int64_t, int64_t, bool, std::array<bool, 2>)’ warning: 5428 | auto outputs = torch::grid_sampler_3d_backward(grad_output, input, *grid, interpolation_mode, padding_mode, (bool)align_corners); warning: | ~~~~~~~^~~~~~~~~~~~~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:657, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/grid_sampler_3d_backward.h:26:54: note: declared here warning: 26 | TORCH_API inline ::std::tuple<at::Tensor,at::Tensor> grid_sampler_3d_backward(const at::Tensor & grad_output, const at::Tensor & input, const at::Tensor & grid, int64_t interpolation_mode, int64_t padding_mode, bool align_corners, ::std::array<bool,2> output_mask) { warning: | ^~~~~~~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_linspace(at::Tensor, scalar, scalar, int64_t, uint8_t, int, int)’: warning: libtch/torch_api_generated.cpp.h:7021:63: error: cannot convert ‘c10::optional’ to ‘int64_t’ {aka ‘long int’} warning: 7021 | auto outputs = torch::linspace(start, end, steps_null ? c10::nullopt : c10::optional(steps_v), at::device(device_of_int(options_device)).dtype(at::ScalarType(options_kind))); warning: | ~~~^~~~~~~~~~~~ warning: | | warning: | c10::optional warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/types.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/all.h:8, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/torch.h:3, warning: from libtch/torch_api.cpp:5: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/generated/variable_factories.h:339:86: note: initializing argument 3 of ‘at::Tensor torch::linspace(const c10::Scalar&, const c10::Scalar&, int64_t, c10::TensorOptions)’ warning: 339 | inline at::Tensor linspace(const at::Scalar & start, const at::Scalar & end, int64_t steps, at::TensorOptions options = {}) { warning: | ~~^~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_linspace_out(at::Tensor, tensor, scalar, scalar, int64_t, uint8_t)’: warning: libtch/torch_api_generated.cpp.h:7028:73: error: cannot convert ‘c10::optional’ to ‘int64_t’ {aka ‘long int’} warning: 7028 | auto outputs = torch::linspace_out(out, start, *end, steps_null ? c10::nullopt : c10::optional(steps_v)); warning: | ~~~^~~~~~~~~~~~ warning: | | warning: | c10::optional warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:785, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/linspace.h:36:120: note: initializing argument 4 of ‘at::Tensor& at::linspace_out(at::Tensor&, const c10::Scalar&, const c10::Scalar&, int64_t)’ warning: 36 | TORCH_API inline at::Tensor & linspace_out(at::Tensor & out, const at::Scalar & start, const at::Scalar & end, int64_t steps) { warning: | ~~^~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_logspace(at::Tensor, scalar, scalar, int64_t, uint8_t, double, int, int)’: warning: libtch/torch_api_generated.cpp.h:7329:63: error: cannot convert ‘c10::optional’ to ‘int64_t’ {aka ‘long int’} warning: 7329 | auto outputs__ = torch::logspace(start, end, steps_null ? c10::nullopt : c10::optional(steps_v), base, at::device(device_of_int(options_device)).dtype(at::ScalarType(options_kind))); warning: | ~~~^~~~~~~~~~~~ warning: | | warning: | c10::optional warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/types.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data/dataloader.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/data.h:3, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/all.h:8, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/api/include/torch/torch.h:3, warning: from libtch/torch_api.cpp:5: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/generated/variable_factories.h:343:86: note: initializing argument 3 of ‘at::Tensor torch::logspace(const c10::Scalar&, const c10::Scalar&, int64_t, double, c10::TensorOptions)’ warning: 343 | inline at::Tensor logspace(const at::Scalar & start, const at::Scalar & end, int64_t steps, double base = 10.0, at::TensorOptions options = {}) { warning: | ~~^~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_logspace_out(at::Tensor, tensor, scalar, scalar, int64_t, uint8_t, double)’: warning: libtch/torch_api_generated.cpp.h:7336:73: error: cannot convert ‘c10::optional’ to ‘int64_t’ {aka ‘long int’} warning: 7336 | auto outputs = torch::logspace_out(out, start, *end, steps_null ? c10::nullopt : c10::optional(steps_v), base); warning: | ~~~^~~~~~~~~~~~ warning: | | warning: | c10::optional warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: In file included from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/Functions.h:805, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/input_metadata.h:10, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/function.h:7, warning: from /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/torch/csrc/autograd/engine.h:11, warning: from libtch/torch_api.cpp:1: warning: /home/ondra/libtorch-cxx11-abi-shared-with-deps-1.12.1+cu116/libtorch/include/ATen/ops/logspace.h:36:120: note: initializing argument 4 of ‘at::Tensor& at::logspace_out(at::Tensor&, const c10::Scalar&, const c10::Scalar&, int64_t, double)’ warning: 36 | TORCH_API inline at::Tensor & logspace_out(at::Tensor & out, const at::Scalar & start, const at::Scalar & end, int64_t steps, double base=10.0) { warning: | ~~^~~ warning: In file included from libtch/torch_api.cpp:10: warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_max_unpool2d_backward(at::Tensor, tensor, tensor, tensor, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:7732:29: error: ‘max_unpool2d_backward’ is not a member of ‘torch’ warning: 7732 | auto outputs__ = torch::max_unpool2d_backward(grad_output, self, indices, torch::IntArrayRef(output_size_data, output_size_len)); warning: | ^~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_max_unpool2d_backward_grad_input(at::Tensor, tensor, tensor, tensor, tensor, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:7739:29: error: ‘max_unpool2d_backward_out’ is not a member of ‘torch’ warning: 7739 | auto outputs__ = torch::max_unpool2d_backward_out(grad_input, grad_output, self, *indices, torch::IntArrayRef(output_size_data, output_size_len)); warning: | ^~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_max_unpool3d_backward(at::Tensor, tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:7760:29: error: ‘max_unpool3d_backward’ is not a member of ‘torch’ warning: 7760 | auto outputs__ = torch::max_unpool3d_backward(grad_output, self, indices, torch::IntArrayRef(output_size_data, output_size_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(padding_data, padding_len)); warning: | ^~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_max_unpool3d_backward_grad_input(at::Tensor, tensor, tensor, tensor, tensor, int64_t, int, int64_t, int, int64_t, int)’: warning: libtch/torch_api_generated.cpp.h:7767:29: error: ‘max_unpool3d_backward_out’ is not a member of ‘torch’ warning: 7767 | auto outputs__ = torch::max_unpool3d_backward_out(grad_input, grad_output, self, *indices, torch::IntArrayRef(output_size_data, output_size_len), torch::IntArrayRef(stride_data, stride_len), torch::IntArrayRef(padding_data, padding_len)); warning: | ^~~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.cpp.h: In function ‘void atg_miopen_convolution_backward_bias(at::Tensor, tensor)’: warning: libtch/torch_api_generated.cpp.h:7928:29: error: ‘miopen_convolution_backward_bias’ is not a member of ‘torch’ warning: 7928 | auto outputs__ = torch::miopen_convolution_backward_bias(*grad_output); warning: | ^~~~~~~~ warning: libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’ warning: 16 | x \ warning: | ^ warning: libtch/torch_api_generated.

tondach01 commented 2 years ago

Update: I figured out that if LIBTORCH variable is undefined, Syntaxdot completes compilation, but throws this symbol undefined error. If defined, the compilation fails ať torch-sys. I tried all versions of LibTorch available (including the CPU) and the result is always the same. Can this be because of outdated torch-sys used during compilation?

josefkr commented 1 year ago

Hi, I was wondering if you had found a solution to the issue regarding the compilation of torch-sys.

I have been trying to install the syntaxdot git code on ubuntu 20.04. I tried both both install types, the one with support for training and the one without training but neither succeeds.

As far as I can tell, I have all the required bits.

info: using existing install for 'stable-x86_64-unknown-linux-gnu' info: default toolchain set to 'stable-x86_64-unknown-linux-gnu'

stable-x86_64-unknown-linux-gnu unchanged - rustc 1.68.2 (9eb3afe9e 2023-03-27)


I tried two setups:

* Version A where I try to use files from the zip archive `libtorch-cxx11-abi-shared-with-deps-2.0.0`

* Version B where I try to use libtorch  from the `torch` python package. This is modeled on the recommendation  for macOS ARM64 on the syntaxdot install page  (though I am not on a mac).

The error messages with both versions look as shown below.

```sh

    Updating crates.io index
  Installing syntaxdot-cli v0.4.1
   Compiling libc v0.2.142
   Compiling proc-macro2 v1.0.56
   Compiling quote v1.0.26

...

error: failed to run custom build command for `torch-sys v0.5.0`

Caused by:
  process didn't exit successfully: `/tmp/cargo-installm7Mpjz/release/build/torch-sys-fb561cb5c3453def/build-script-build` (exit status: 1)
  --- stdout
  cargo:rerun-if-env-changed=TORCH_CUDA_VERSION
  cargo:rerun-if-env-changed=LIBTORCH
  cargo:rustc-link-search=native=/mnt/big/tools/libtorch_abi/lib
  cargo:rerun-if-changed=libtch/torch_api.cpp
  cargo:rerun-if-changed=libtch/torch_api.h
  cargo:rerun-if-changed=libtch/torch_api_generated.cpp.h
  cargo:rerun-if-changed=libtch/torch_api_generated.h
  cargo:rerun-if-changed=libtch/stb_image_write.h
  cargo:rerun-if-changed=libtch/stb_image_resize.h
  cargo:rerun-if-changed=libtch/stb_image.h
  cargo:rerun-if-env-changed=LIBTORCH_CXX11_ABI
  TARGET = Some("x86_64-unknown-linux-gnu")

  ...
      |                                                                                                     |
  cargo:warning=      |                                                                                                     c10::optional<c10::ArrayRef<long int> >
  cargo:warning=libtch/torch_api.h:16:5: note: in definition of macro ‘PROTECT’
  cargo:warning=   16 |     x \
  cargo:warning=      |     ^
  exit status: 1

  --- stderr

  error occurred: Command "c++" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "-m64" "-I" "/mnt/big/tools/libtorch_abi/include" "-I" "/mnt/big/tools/libtorch_abi/include/torch/csrc/api/include" "-Wl,-rpath=/mnt/big/tools/libtorch_abi/lib" "-std=c++14" "-D_GLIBCXX_USE_CXX11_ABI=1" "-o" "/tmp/cargo-installKy08Tc/release/build/torch-sys-10cb96feddf7928c/out/libtch/torch_api.o" "-c" "libtch/torch_api.cpp" with args "c++" did not execute successfully (status code exit status: 1).

I subsequently also tried to install syntaxdot from crates.io.

I get the same kind of error when doing cargo install --version 0.5.0-beta.2 syntaxdot-cli except that it is torch-sys v0.9.0 that's not being built . When trying to install beta1, it fails for torch-sys v0.8.0.

danieldk commented 1 year ago

libtorch 2.0.0 was not yet supported until I merged the 2.0.0 support PR a few minutes ago. The issue is that the Torch C++ API (which the binding uses) is not stable, so the Torch binding and SyntaxDot can only work with one particular Torch version.

I am sorry that this was not clear in the documentation. I will update the documentation to mention this explicitly in the documentation. We will also provide a precompiled CUDA build for the next release, so that there is a ready-to-run binary for training as well.

josefkr commented 1 year ago

Thank you so much for all the recent work on this. I have now been able to install syntaxdot from crates.io.

If it's ok, I'd like to tack on another question: could you provide a minimal example of how to call syntaxdot from the commandline? I am not quite sure what needs to go in the required conf file; where the files named in conf need to be located; and what info needs to be in them .

danieldk commented 1 year ago

If it's ok, I'd like to tack on another question: could you provide a minimal example of how to call syntaxdot from the commandline? I am not quite sure what needs to go in the required conf file; where the files named in conf need to be located; and what info needs to be in them .

I'd recommend you to download one of the existing finetuned models to get an idea of what a configuration could look like, eg.:

https://github.com/tensordot/syntaxdot-models/releases/download/de-ud-2021/de-ud-huge-20210307.tar.gz

The finetuning command is then something like:

syntaxdot prepare syntaxdot.conf train.conll
syntaxdot finetune --gpu 0 --mixed-precision --batch-size 32 --label-smoothing 0.03 --warmup 10000 --maxlen 100 --keep-best 3 syntaxdot.conf xlm-roberta-checkpoint.pt train.conll dev.conll

The checkpoint needs to be converted to SyntaxDot format using one of the scripts in:

https://github.com/tensordot/syntaxdot/tree/main/scripts

I still want to add support for using the checkpoints that are provided through Huggingface Hub directly, but I didn't have time for that yet.

I am currently on vacation, but I'll try to do a more complete write-up and add more examples later.

Apologies for the incomplete documentation, I haven't had much time to work on SyntaxDot for the last 1.5 years or so.