alibaba / GraphScope

🔨 🍇 💻 🚀 GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统
https://graphscope.io
Apache License 2.0
3.17k stars 425 forks source link

[BUG] GraphScope Interactive's adhoc query fails on aocc compiler #3542

Open zhanglei1949 opened 4 months ago

zhanglei1949 commented 4 months ago

Building and running Interactive from source with aocc compiler:

Query name

MATCH(n) return COUNT(n);
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0207 09:46:46.874811 2114829 gen_code_from_plan.cc:125] Start generating hqps code
I0207 09:46:46.874884 2114829 gen_code_from_plan.cc:75] Start deserializing from: /tmp/codegen//-76598767/query_-76598767.pb
I0207 09:46:46.874930 2114829 gen_code_from_plan.cc:77] Deserilized plan size : 377, from /tmp/codegen//-76598767/query_-76598767.pb
I0207 09:46:46.875005 2114829 gen_code_from_plan.cc:82] deserilized plan size : 377
I0207 09:46:46.875048 2114829 hqps_generator.h:296] Found 3 operators in the plan
I0207 09:46:46.875095 2114829 hqps_generator.h:314] Found a scan operator
W0207 09:46:46.875104 2114829 query_params_parser.h:62] params has more than 1 labels
I0207 09:46:46.875155 2114829 hqps_generator.h:420] Found a group by operator with no group by keys
I0207 09:46:46.875185 2114829 hqps_generator.h:425] Finish groupby operator gen
I0207 09:46:46.875196 2114829 hqps_generator.h:508] Found a sink operator
I0207 09:46:46.875208 2114829 hqps_generator.h:532] Finish adding query
I0207 09:46:46.875236 2114829 gen_code_from_plan.cc:87] Start writing to: /tmp/codegen//-76598767/query_-76598767.cc
I0207 09:46:46.875308 2114829 gen_code_from_plan.cc:56] Finish writing to: /tmp/codegen//-76598767/query_-76598767.cc
I0207 09:46:46.875322 2114829 gen_code_from_plan.cc:134] Successfully generated code to /tmp/codegen//-76598767/query_-76598767.cc
[2024-02-07 09:46:46] -INFO- ---------------------------- 
[2024-02-07 09:46:46] -INFO- Start running cmake and make 
/tmp/codegen/-76598767 /workspaces/GraphScope/flex/build
[2024-02-07 09:46:46] -INFO- CMake command = cmake . -DQUERY_NAME=query_-76598767 -DFLEX_INCLUDE_PREFIX=/workspaces/GraphScope/flex/../ 
[2024-02-07 09:46:46] -INFO- --------------------------- 
-- The CXX compiler identification is Clang 16.0.3
-- Check for working CXX compiler: /opt/AMD/aocc-compiler-4.1.0/bin/clang++
-- Check for working CXX compiler: /opt/AMD/aocc-compiler-4.1.0/bin/clang++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
Query name query_-76598767
flex header install dir /workspaces/GraphScope/flex/../
-- Could NOT find MPI_CXX (missing: MPI_CXX_WORKS) 
-- Could NOT find MPI (missing: MPI_CXX_FOUND) 
CMake Warning at CMakeLists.txt:31 (message):
  mpi not found, build without mpi

-- Configuring done
-- Generating done
-- Build files have been written to: /tmp/codegen/-76598767
[2024-02-07 09:46:48] -INFO- Make command = make -j1 
Scanning dependencies of target query_-76598767
[ 50%] Building CXX object CMakeFiles/query_-76598767.dir/query_-76598767.cc.o
clang-16: warning: -Wl,-rpath,RIGIN: 'linker' input unused [-Wunused-command-line-argument]
clang-16: warning: argument unused during compilation: '-no-pie' [-Wunused-command-line-argument]
In file included from /tmp/codegen/-76598767/query_-76598767.cc:5:
In file included from /workspaces/GraphScope/flex/../flex/engines/hqps_db/core/sync_engine.h:23:
In file included from /workspaces/GraphScope/flex/../flex/engines/hqps_db/structures/multi_vertex_set/general_vertex_set.h:24:
In file included from /usr/local/include/grape/utils/bitset.h:25:
In file included from /usr/local/include/grape/utils/thread_pool.h:43:
In file included from /usr/local/include/grape/parallel/parallel_engine_spec.h:19:
/usr/local/include/grape/worker/comm_spec.h:19:10: fatal error: 'mpi.h' file not found
#include <mpi.h>
         ^~~~~~~
1 error generated.
make[2]: *** [CMakeFiles/query_-76598767.dir/build.make:63: CMakeFiles/query_-76598767.dir/query_-76598767.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:76: CMakeFiles/query_-76598767.dir/all] Error 2
make: *** [Makefile:84: all] Error 2
I0207 09:46:54.184659 2112955 codegen_proxy.cc:169] Codegen cmd: [/workspaces/GraphScope/flex/bin/load_plan_and_gen.sh -e=hqps  -i=/tmp/codegen//-76598767/query_-76598767.pb -o=/tmp/codegen//-76598767 --procedure_name=query_-76598767 -w=/tmp/codegen//-76598767 --ir_conf=../tests/hqps/engine_config_test.yaml --graph_schema_path=/tmp/interactive_workspace/data/movies/graph.yaml] return: 512
E0207 09:46:54.184742 2112952 codegen_proxy.cc:119] Expected lib path /tmp/codegen//-76598767/libquery_-76598767.so not exists, or compilation failure: 512 compilation failed
E0207 09:46:54.184792 2112952 codegen_proxy.cc:81] Codegen failed
github-actions[bot] commented 4 months ago

/cc @yecol @sighingnow, this issus/pr has had no activity for a long time, please help to review the status and assign people to work on it.