search

apache / incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
https://gluten.apache.org/
Apache License 2.0
1.03k stars 368 forks source link

[CORE] Build failed for macOS #5792

Closed xumingming closed 1 week ago

xumingming commented 2 weeks ago

Problem description

gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from gluten/cpp/core/shuffle/RoundRobinPartitioner.cc:18:
In file included from gluten/cpp/core/shuffle/RoundRobinPartitioner.h:20:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from gluten/cpp/core/shuffle/FallbackRangePartitioner.cc:1:
In file included from gluten/cpp/core/shuffle/FallbackRangePartitioner.h:20:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
1 error generated.
1 error generated.
1 error generated.
make[2]: *** [core/CMakeFiles/gluten.dir/shuffle/RoundRobinPartitioner.cc.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[2]: *** [core/CMakeFiles/gluten.dir/shuffle/Partitioner.cc.o] Error 1
make[2]: *** [core/CMakeFiles/gluten.dir/shuffle/FallbackRangePartitioner.cc.o] Error 1
In file included from gluten/cpp/core/shuffle/HashPartitioner.cc:18:
In file included from gluten/cpp/core/shuffle/HashPartitioner.h:20:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
1 error generated.
make[2]: *** [core/CMakeFiles/gluten.dir/shuffle/HashPartitioner.cc.o] Error 1
In file included from gluten/cpp/core/compute/ResultIterator.cc:19:
In file included from gluten/cpp/core/compute/Runtime.h:32:
In file included from gluten/cpp/core/shuffle/ShuffleWriter.h:29:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from gluten/cpp/core/compute/Runtime.cc:18:
In file included from gluten/cpp/core/compute/Runtime.h:32:
In file included from gluten/cpp/core/shuffle/ShuffleWriter.h:29:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from gluten/cpp/core/jni/JniWrapper.cc:21:
In file included from gluten/cpp/core/compute/Runtime.h:32:
In file included from gluten/cpp/core/shuffle/ShuffleWriter.h:29:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from gluten/cpp/core/config/GlutenConfig.cc:22:
In file included from gluten/cpp/core/jni/JniError.h:22:
In file included from gluten/cpp/core/jni/JniCommon.h:26:
In file included from gluten/cpp/core/compute/Runtime.h:32:
In file included from gluten/cpp/core/shuffle/ShuffleWriter.h:29:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from gluten/cpp/core/shuffle/LocalPartitionWriter.cc:24:
In file included from gluten/cpp/core/shuffle/LocalPartitionWriter.h:24:
In file included from gluten/cpp/core/shuffle/ShuffleWriter.h:29:
gluten/cpp/core/shuffle/Partitioner.h:21:10: fatal error: 'folly/container/F14Map.h' file not found
#include <folly/container/F14Map.h>
         ^~~~~~~~~~~~~~~~~~~~~~~~~~

System information

Velox System Info v0.0.2 Commit: a4b69a2f141bbc9eede669cc337112845cd712ef CMake Version: 3.29.3 System: Darwin-23.1.0 Arch: arm64 C++ Compiler: /Library/Developer/CommandLineTools/usr/bin/c++ C++ Compiler Version: 15.0.0.15000040 C Compiler: /Library/Developer/CommandLineTools/usr/bin/cc C Compiler Version: 15.0.0.15000040 CMake Prefix Path: /Library/Developer/CommandLineTools/SDKs/MacOSX14.0.sdk/usr;/opt/homebrew;/usr/local;/usr;/;/opt/homebrew/Cellar/cmake/3.29.3;/usr/X11R6;/usr/pkg;/opt;/sw;/opt/local

CMake log

No response

xumingming commented 2 weeks ago

Seems introduced by https://github.com/apache/incubator-gluten/pull/5675 . I'd suggest add a CI build check for macOS, Gluten's build fail on macOS quite often.