apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
615 stars 113 forks source link

Build failed #131

Closed wankunde closed 3 months ago

wankunde commented 3 months ago

Describe the bug

Build failed with make release, error log:

error: could not compile `datafusion-physical-expr` (lib)

Caused by:
  process didn't exit successfully: `/home/codespace/.rustup/toolchains/nightly-2023-09-05-x86_64-unknown-linux-gnu/bin/rustc --crate-name datafusion_physical_expr --edition=2021 /home/codespace/.cargo/registry/src/index.crates.io-6f17d22bba15001f/datafusion-physical-expr-36.0.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=191 --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C codegen-units=1 -C debuginfo=2 --cfg 'feature="base64"' --cfg 'feature="blake2"' --cfg 'feature="blake3"' --cfg 'feature="crypto_expressions"' --cfg 'feature="default"' --cfg 'feature="encoding_expressions"' --cfg 'feature="hex"' --cfg 'feature="md-5"' --cfg 'feature="regex"' --cfg 'feature="regex_expressions"' --cfg 'feature="sha2"' --cfg 'feature="unicode-segmentation"' --cfg 'feature="unicode_expressions"' -C metadata=a325a275440a781d -C extra-filename=-a325a275440a781d --out-dir /workspaces/arrow-datafusion-comet/core/target/release/deps -C strip=debuginfo -L dependency=/workspaces/arrow-datafusion-comet/core/target/release/deps --extern ahash=/workspaces/arrow-datafusion-comet/core/target/release/deps/libahash-601ed8b069a9a5a6.rmeta --extern arrow=/workspaces/arrow-datafusion-comet/core/target/release/deps/libarrow-ffd647175187152e.rmeta --extern arrow_array=/workspaces/arrow-datafusion-comet/core/target/release/deps/libarrow_array-3242d557728b5587.rmeta --extern arrow_buffer=/workspaces/arrow-datafusion-comet/core/target/release/deps/libarrow_buffer-e211392312fe7bba.rmeta --extern arrow_ord=/workspaces/arrow-datafusion-comet/core/target/release/deps/libarrow_ord-4009ea50b2ebd714.rmeta --extern arrow_schema=/workspaces/arrow-datafusion-comet/core/target/release/deps/libarrow_schema-508477766abc3a1b.rmeta --extern arrow_string=/workspaces/arrow-datafusion-comet/core/target/release/deps/libarrow_string-adeca8013456b92b.rmeta --extern base64=/workspaces/arrow-datafusion-comet/core/target/release/deps/libbase64-0a92d74327cbe3f2.rmeta --extern blake2=/workspaces/arrow-datafusion-comet/core/target/release/deps/libblake2-f6c607066333419f.rmeta --extern blake3=/workspaces/arrow-datafusion-comet/core/target/release/deps/libblake3-8ab5e500087a9be8.rmeta --extern chrono=/workspaces/arrow-datafusion-comet/core/target/release/deps/libchrono-56c7e6f55a55f793.rmeta --extern datafusion_common=/workspaces/arrow-datafusion-comet/core/target/release/deps/libdatafusion_common-b8b0aa0abd58c8f8.rmeta --extern datafusion_execution=/workspaces/arrow-datafusion-comet/core/target/release/deps/libdatafusion_execution-59d01f88040f6bff.rmeta --extern datafusion_expr=/workspaces/arrow-datafusion-comet/core/target/release/deps/libdatafusion_expr-49fb18fb28a89a5d.rmeta --extern half=/workspaces/arrow-datafusion-comet/core/target/release/deps/libhalf-8fae39a540834959.rmeta --extern hashbrown=/workspaces/arrow-datafusion-comet/core/target/release/deps/libhashbrown-e101173ad49e5ec8.rmeta --extern hex=/workspaces/arrow-datafusion-comet/core/target/release/deps/libhex-fef23b1eb5ff2b0d.rmeta --extern indexmap=/workspaces/arrow-datafusion-comet/core/target/release/deps/libindexmap-619e7afe6ff2edf1.rmeta --extern itertools=/workspaces/arrow-datafusion-comet/core/target/release/deps/libitertools-0dc67bd9365a71f7.rmeta --extern log=/workspaces/arrow-datafusion-comet/core/target/release/deps/liblog-124a1c10a6bdb0f8.rmeta --extern md5=/workspaces/arrow-datafusion-comet/core/target/release/deps/libmd5-1bc859f0543cb0bd.rmeta --extern paste=/workspaces/arrow-datafusion-comet/core/target/release/deps/libpaste-b3d74cabbd8a783c.so --extern petgraph=/workspaces/arrow-datafusion-comet/core/target/release/deps/libpetgraph-d7cf48a3d8b91c71.rmeta --extern rand=/workspaces/arrow-datafusion-comet/core/target/release/deps/librand-2b5383211fd330e0.rmeta --extern regex=/workspaces/arrow-datafusion-comet/core/target/release/deps/libregex-974dc50dee6bd8d6.rmeta --extern sha2=/workspaces/arrow-datafusion-comet/core/target/release/deps/libsha2-fe77a06056d42fbc.rmeta --extern unicode_segmentation=/workspaces/arrow-datafusion-comet/core/target/release/deps/libunicode_segmentation-3a0c0e40bc800e6e.rmeta --extern uuid=/workspaces/arrow-datafusion-comet/core/target/release/deps/libuuid-85748afea3e3e467.rmeta --cap-lints allow -Ctarget-cpu=native -L native=/workspaces/arrow-datafusion-comet/core/target/release/build/blake3-65ced86a4b388c2f/out -L native=/workspaces/arrow-datafusion-comet/core/target/release/build/blake3-65ced86a4b388c2f/out` (signal: 15, SIGTERM: termination signal)
warning: build failed, waiting for other jobs to finish...

Steps to reproduce

Run make release in github codespace.

Expected behavior

Build a release version.

Additional context

No response

sunchao commented 3 months ago

Hmm, @wankunde could you share more about your environment? I just tried make release on Apple M3 Max and it succeeded.

viirya commented 3 months ago

I just do make releas on M1 Mac and it is also good.

viirya commented 3 months ago

error: could not compile datafusion-physical-expr (lib)

Seems you cannot build datafusion actually. Could you try to build datafusion from its repo to test it?

wankunde commented 3 months ago

I can build the release version in my Macbook too, I can also run the make command without the release flag in ubuntu. Only fail for make release in ubuntu.

sunchao commented 3 months ago

I don't have Ubuntu on my Linux laptop but Fedora 38 instead. It also worked with make release.

Maybe you can try cargo clean first in the core directory? Like @viirya suggested, try build DataFusion first and see if that works.

wankunde commented 3 months ago

I'm sorry, as datafusion depends on protobuf-compiler, this issue has been fixed after installation. And add the virtual machine with large memory to fix ld problem.

The build has been successful, close this issue.

Thanks.

viirya commented 3 months ago

Thanks @wankunde