huggingface / text-embeddings-inference

A blazing fast inference solution for text embeddings models
https://huggingface.co/docs/text-embeddings-inference/quick_tour
Apache License 2.0
2.36k stars 145 forks source link

Failed building with cargo #136

Open SingL3 opened 6 months ago

SingL3 commented 6 months ago

System Info

Ubuntu 20.04 cargo 1.75.0 (1d8b05cdd 2023-11-20) 4xA100

Information

Tasks

Reproduction

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

cd text-embeddings-inference
cargo install --path router -F candle-cuda --no-default-features

Error:

   Compiling stable_deref_trait v1.2.0
   Compiling lazy_static v1.4.0
   Compiling openssl v0.10.63
   Compiling mime v0.3.17
   Compiling base64 v0.21.7
   Compiling foreign-types-shared v0.1.1
error: could not compile `memchr` (lib)

Caused by:
  process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name memchr --edition=2021 /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memchr-2.7.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C panic=abort -C lto=off -C embed-bitcode=no -C debuginfo=1 --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=4787abf57b9037bf -C extra-filename=-4787abf57b9037bf --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
warning: build failed, waiting for other jobs to finish...
error: could not compile `vcpkg` (lib)

Caused by:
  process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name vcpkg /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/vcpkg-0.2.15/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=4f11aecc207ce7b2 -C extra-filename=-4f11aecc207ce7b2 --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
error: failed to compile `text-embeddings-router v0.6.0 (/mnt/home/search/serving/text-embeddings-inference/router)`, intermediate artifacts can be found at `/mnt/home/search/serving/text-embeddings-inference/target`.
To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.

Expected behavior

Install successfully.

SingL3 commented 6 months ago

It may raise error in different process:

   Compiling lazy_static v1.4.0
   Compiling openssl v0.10.63
   Compiling mime v0.3.17
   Compiling base64 v0.21.7
   Compiling bitflags v2.4.2
   Compiling version_check v0.9.4
   Compiling strsim v0.10.0
   Compiling num-traits v0.2.17
   Compiling lock_api v0.4.11
error: could not compile `memchr` (lib)

Caused by:
  process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name memchr --edition=2021 /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memchr-2.7.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=633e5bec155430e2 -C extra-filename=-633e5bec155430e2 --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
warning: build failed, waiting for other jobs to finish...
error: could not compile `rustc-demangle` (lib)

Caused by:
  process didn't exit successfully: `/root/.rustup/toolchains/1.73.0-x86_64-unknown-linux-gnu/bin/rustc --crate-name rustc_demangle /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rustc-demangle-0.1.23/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=171 --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=156950085b5541ae -C extra-filename=-156950085b5541ae --out-dir /mnt/home/search/serving/text-embeddings-inference/target/release/deps -L dependency=/mnt/home/search/serving/text-embeddings-inference/target/release/deps --cap-lints allow -C target-cpu=native` (signal: 7, SIGBUS: access to undefined memory)
error: failed to compile `text-embeddings-router v0.6.0 (/mnt/home/search/serving/text-embeddings-inference/router)`, intermediate artifacts can be found at `/mnt/home/search/serving/text-embeddings-inference/target`.
To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.
shoang22 commented 6 months ago

+1

Narsil commented 6 months ago

Anything specific on the machines you are running regarding AVX/SIMD ?

What are the CPUs ? https://github.com/BurntSushi/memchr/issues/57 Might be showing some insights.