search

triton-inference-server / server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.
https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
BSD 3-Clause "New" or "Revised" License
7.81k stars 1.42k forks source link

Install Triton Inference Server without Docker containers #6780

Open lyc728 opened 6 months ago

lyc728 commented 6 months ago

/usr/bin/ld: ../libtritonserver.so: undefined reference to absl::lts_20220623::StartsWithIgnoreCase(absl::lts_20220623::string_view, absl::lts_20220623::string_view)' /usr/bin/ld: ../libtritonserver.so: undefined reference toabsl::lts_20220623::numbers_internal::safe_strto64_base(absl::lts_20220623::string_view, long, int)' /usr/bin/ld: ../libtritonserver.so: undefined reference to `absl::lts_20220623::ParseTime(absl::lts_20220623::string_view, absl::lts_20220623::string_view, absl::lts_20220623::Time, std::__cxx11::basic_string<char, std::char_traits, std::allocator >)' /usr/bin/ld: ../libtritonserver.so: undefined reference to absl::lts_20220623::FormatTime[abi:cxx11](absl::lts_20220623::string_view, absl::lts_20220623::Time, absl::lts_20220623::TimeZone)' /usr/bin/ld: ../libtritonserver.so: undefined reference toabsl::lts_20220623::operator<<(std::ostream&, absl::lts_20220623::string_view)' /usr/bin/ld: ../libtritonserver.so: undefined reference to absl::lts_20220623::optional_internal::throw_bad_optional_access()' /usr/bin/ld: ../libtritonserver.so: undefined reference toabsl::lts_20220623::numbers_internal::safe_strtou32_base(absl::lts_20220623::string_view, unsigned int, int)' /usr/bin/ld: ../libtritonserver.so: undefined reference to absl::lts_20220623::numbers_internal::safe_strtou64_base(absl::lts_20220623::string_view, unsigned long*, int)' /usr/bin/ld: ../libtritonserver.so: undefined reference toabsl::lts_20220623::string_view::find(absl::lts_20220623::string_view, unsigned long) const' /usr/bin/ld: ../libtritonserver.so: undefined reference to absl::lts_20220623::ByChar::Find(absl::lts_20220623::string_view, unsigned long) const' /usr/bin/ld: ../libtritonserver.so: undefined reference toabsl::lts_20220623::variant_internal::ThrowBadVariantAccess()' /usr/bin/ld: ../libtritonserver.so: undefined reference to absl::lts_20220623::numbers_internal::safe_strto32_base(absl::lts_20220623::string_view, int*, int)' /usr/bin/ld: ../libtritonserver.so: undefined reference toabsl::lts_20220623::string_view::find(char, unsigned long) const' /usr/bin/ld: ../libtritonserver.so: undefined reference to `absl::lts_20220623::strings_internal::CatPiecesabi:cxx11' collect2: error: ld returned 1 exit status make[5]: [test/CMakeFiles/response_cache_test.dir/build.make:306: test/response_cache_test] Error 1 make[5]: Leaving directory '/data/Triton_Inference_Server/build/tritonserver/build/_deps/repo-core-build/triton-core' make[4]: [CMakeFiles/Makefile2:644: test/CMakeFiles/response_cache_test.dir/all] Error 2 make[4]: Leaving directory '/data/Triton_Inference_Server/build/tritonserver/build/_deps/repo-core-build/triton-core' make[3]: [Makefile:136: all] Error 2 make[3]: Leaving directory '/data/Triton_Inference_Server/build/tritonserver/build/_deps/repo-core-build/triton-core' make[2]: [_deps/repo-core-build/CMakeFiles/triton-core.dir/build.make:86: _deps/repo-core-build/triton-core/src/triton-core-stamp/triton-core-build] Error 2 make[2]: Leaving directory '/data/Triton_Inference_Server/build/tritonserver/build' make[1]: [CMakeFiles/Makefile2:737: _deps/repo-core-build/CMakeFiles/triton-core.dir/all] Error 2 make[1]: Leaving directory '/data/Triton_Inference_Server/build/tritonserver/build' make: [Makefile:136: all] Error 2 error: build failed

lyc728 commented 6 months ago

python build.py -v --no-container-build --build-dir=/data/Triton_Inference_Server/build --enable-all

zhaohb commented 6 months ago

same problem, how to fix that?

dyastremsky commented 5 months ago

Can you please provide full reproduction steps (all commands run) and fill out the bug template below? Thank you!

--

Description A clear and concise description of what the bug is.

Triton Information What version of Triton are you using?

Are you using the Triton container or did you build it yourself?

To Reproduce Steps to reproduce the behavior.

Describe the models (framework, inputs, outputs), ideally include the model configuration file (if using an ensemble include the model configuration file for that as well).

Expected behavior A clear and concise description of what you expected to happen.