parkerzf
commented
2 years ago Any updates on this? Thanks!
Open parkerzf opened 2 years ago
parkerzf
commented
2 years ago Any updates on this? Thanks!
lidongze0629
commented
2 years ago @parkerzf I'm trying to reproduce this problem under GCC version 4.8.5
parkerzf
commented
2 years ago @parkerzf I'm trying to reproduce this problem under GCC version 4.8.5
Thanks Lidong! Could you let us know what are the GCC version in your setup? We also can reproduce that to see if the problem resolved.
lidongze0629
commented
2 years ago @parkerzf I'm trying to reproduce this problem under GCC version 4.8.5
Thanks Lidong! Could you let us know what are the GCC version in your setup? We also can reproduce that to see if the problem resolved.
gcc 7.1+
lidongze0629
commented
2 years ago Hi, @parkerzf The minimum GCC version supported by GraphScope is 5.4.
parkerzf
commented
2 years ago Hey lidong, thanks for the inspection. However, we get some other compiling error even using GCC 11.2.0. I will share it later in the comment.
parkerzf
commented
2 years ago 2022-07-06 14:59:38,718 [INFO][session:1479]: Creating default session ...
2022-07-06 14:59:38,719 [INFO][session:682]: Initializing graphscope session with parameters: {'addr': None, 'mode': 'eager', 'cluster_type': 'hosts', 'num_workers': 1, 'preemptive': True, 'k8s_namespace': None, 'k8s_service_type': 'NodePort', 'k8s_gs_image': 'registry.cn-hongkong.aliyuncs.com/graphscope/graphscope:0.14.0', 'k8s_etcd_image': 'quay.io/coreos/etcd:v3.4.13', 'k8s_image_pull_policy': 'IfNotPresent', 'k8s_image_pull_secrets': [], 'k8s_coordinator_cpu': 1.5, 'k8s_coordinator_mem': '2Gi', 'etcd_addrs': None, 'k8s_etcd_num_pods': 1, 'k8s_etcd_cpu': 1.0, 'k8s_etcd_mem': '512Mi', 'k8s_vineyard_daemonset': 'none', 'k8s_vineyard_cpu': 0.2, 'k8s_vineyard_mem': '512Mi', 'vineyard_shared_mem': '4Gi', 'k8s_engine_cpu': 0.2, 'k8s_engine_mem': '1Gi', 'k8s_mars_worker_cpu': 0.2, 'k8s_mars_worker_mem': '4Mi', 'k8s_mars_scheduler_cpu': 0.2, 'k8s_mars_scheduler_mem': '2Mi', 'with_mars': False, 'reconnect': False, 'k8s_volumes': {}, 'k8s_waiting_for_delete': False, 'timeout_seconds': 600, 'dangling_timeout_seconds': 600, 'mount_dataset': None, 'k8s_dataset_image': 'registry.cn-hongkong.aliyuncs.com/graphscope/dataset:0.14.0', 'hosts': ['localhost'], 'port': None, 'vineyard_socket': '', 'k8s_client_config': {}}
2022-07-06 14:59:38,723 [INFO][cluster:119]: Initializing coordinator with command: /home/ubuntu/venvs/graphscope_test/bin/python3.8 -m gscoordinator --num_workers 1 --hosts localhost --log_level INFO --timeout_seconds 600 --port 45846 --cluster_type hosts --instance_id mbxgob --vineyard_shared_mem 4Gi
2022-07-06 14:59:38,732 [INFO][cluster:183]: Coordinator service started successful, connecting to service...
2022-07-06 14:59:39,698 [INFO][launcher:364]: Launch etcd with command: /home/ubuntu/venvs/graphscope_test/bin/etcd --data-dir /tmp/gs/mbxgob --listen-peer-urls http://0.0.0.0:2380 --listen-client-urls http://0.0.0.0:61039 --advertise-client-urls http://127.0.0.1:61039 --initial-cluster default=http://127.0.0.1:2380 --initial-advertise-peer-urls http://127.0.0.1:2380
2022-07-06 14:59:39,703 [INFO][launcher:380]: Server is initializing etcd.
2022-07-06 14:59:40,716 [INFO][launcher:392]: Etcd is ready, endpoint is localhost:61039
2022-07-06 14:59:40,722 [INFO][launcher:466]: Launch vineyardd with command: /home/ubuntu/venvs/graphscope_test/bin/python3.8 -m vineyard --socket /tmp/vineyard.sock.1657119580.716646 --rpc_socket_port 9600 --size 4Gi -etcd_endpoint http://127.0.0.1:61039 -etcd_prefix vineyard.gsa.1657119580.716646
2022-07-06 14:59:40,727 [INFO][launcher:482]: Server is initializing vineyardd.
2022-07-06 14:59:41,729 [INFO][launcher:501]: Vineyardd is ready, ipc socket is /tmp/vineyard.sock.1657119580.716646
2022-07-06 14:59:41,747 [INFO][launcher:541]: Launch analytical engine with command: /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/bin/grape_engine --host 0.0.0.0 --port 51021 --vineyard_shared_mem 4Gi -v 1 --vineyard_socket /tmp/vineyard.sock.1657119580.716646
2022-07-06 14:59:41,752 [INFO][launcher:557]: Server is initializing analytical engine.
I0706 14:59:41.000000 34021 /work/analytical_engine/core/grape_instance.cc:86] Workers of grape-engine initialized.
I0706 14:59:41.000000 34030 /work/analytical_engine/core/server/analytical_server.cc:43] Analytical server is listening on 0.0.0.0:51021
2022-07-06 14:59:42,769 [INFO][launcher:574]: Analytical engine is ready, endpoint is localhost:51021
2022-07-06 14:59:42,783 [INFO][launcher:424]: Server is initializing zetcd.
2022-07-06 14:59:42,794 [INFO][launcher:435]: ZEtcd is ready, endpoint is localhost:2181
2022-07-06 14:59:42,801 [INFO][coordinator:197]: Java initial class path set to: /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/grape-runtime-0.1-shaded.jar
2022-07-06 14:59:42,811 [INFO][coordinator:1742]: Coordinator server listen at 0.0.0.0:45846
2022-07-06 14:59:48,789 [INFO][rpc:69]: GraphScope coordinator service connected.
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:1178] Registering Graph, graph type: ARROW_PROPERTY, Type sigature: 7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae, lib path: /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/precompiled/builtin/7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae/lib7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae.so
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:143] Loading graph, graph name: graph_a37JncCH, graph type: ArrowFragment, type sig: 7032b4933ddfc3982f464a605b25b95e4ceec59a2d5541948024b4571758e2ae
Loading empty graph: 0%| | 0/10 [00:00<?, ?it/s]
Loading empty graph: 100%|██████████| 10/10 [00:00<00:00, 391.63it/s]
2022-07-06 14:59:54,124 [WARNING][graph:505]: Deducing vertex labels _
Loading edge labeled _: 0%| | 0/10 [00:00<?, ?it/s]
Loading edge labeled _: 100%|██████████| 10/10 [00:00<00:00, 232.84it/s]
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:196] Unloading Graph graph_a37JncCH
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:1178] Registering Graph, graph type: ARROW_PROJECTED, Type sigature: e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9, lib path: /tmp/gs/builtin/e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9/libe1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9.so
I0706 14:59:54.000000 34031 /work/analytical_engine/core/grape_instance.cc:246] Projecting graph graph_ryDsbzay to simple graph: graph_projected_y4cBWDxS, type sig: e1ba0796515bc85372f70618d0a21153e68a0e3f26e9374eebe573551acb16b9
2022-07-06 14:59:54,238 [INFO][utils:191]: Codegened graph type: gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t>, Graph header: core/fragment/arrow_projected_fragment.h
2022-07-06 14:59:54,263 [INFO][utils:253]: Codegened application type: cpp_pie, app header: wcc/wcc_auto.h, app_class: grape::WCCAuto<_GRAPH_TYPE>, vd_type: None, md_type: None, pregel_combine: None, java_jar_path: None, java_app_class: None
2022-07-06 14:59:54,263 [INFO][utils:267]: Codegened graph type: gs::ArrowProjectedFragment<std::string,uint64_t,std::string,int64_t>, Graph header: core/fragment/arrow_projected_fragment.h
2022-07-06 14:59:54,264 [INFO][utils:357]: Building app ...
CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/arrow/Findre2Alt.cmake:25 (find_package):
By not providing "Findre2.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "re2", but
CMake did not find one.
Could not find a package configuration file provided by "re2" with any of
the following names:
re2Config.cmake
re2-config.cmake
Add the installation prefix of "re2" to CMAKE_PREFIX_PATH or set "re2_DIR"
to a directory containing one of the above files. If "re2" provides a
separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/cmake/data/share/cmake-3.22/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/arrow/ArrowConfig.cmake:97 (find_dependency)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:213 (include)
CMake Warning at /usr/lib/x86_64-linux-gnu/cmake/arrow/Findc-aresAlt.cmake:25 (find_package):
By not providing "Findc-ares.cmake" in CMAKE_MODULE_PATH this project has
asked CMake to find a package configuration file provided by "c-ares", but
CMake did not find one.
Could not find a package configuration file provided by "c-ares" with any
of the following names:
c-aresConfig.cmake
c-ares-config.cmake
Add the installation prefix of "c-ares" to CMAKE_PREFIX_PATH or set
"c-ares_DIR" to a directory containing one of the above files. If "c-ares"
provides a separate development package or SDK, be sure it has been
installed.
Call Stack (most recent call first):
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/cmake/data/share/cmake-3.22/Modules/CMakeFindDependencyMacro.cmake:47 (find_package)
/usr/lib/x86_64-linux-gnu/cmake/arrow/ArrowConfig.cmake:97 (find_dependency)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:206 (find_package)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:313 (arrow_find_package_cmake_package_configuration)
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/lib/cmake/graphscope-analytical/cmake/FindArrow.cmake:350 (arrow_find_package)
CMakeLists.txt:213 (include)
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/assert.hpp:35,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept_check.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/concepts.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size_type.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size.hpp:21,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/functions.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range_core.hpp:38,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range.hpp:13,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/as_literal.hpp:22,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/trim.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp: In instantiation of ‘static void boost::concepts::constraint<Model>::failed() [with Model = boost::algorithm::FinderConcept<boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>, __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > >]’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/find_format.hpp:99:13: required from ‘void boost::algorithm::find_format(SequenceT&, FinderT, FormatterT) [with SequenceT = std::basic_string<char>; FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; FormatterT = boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/replace.hpp:179:44: required from ‘void boost::algorithm::replace_first(SequenceT&, const Range1T&, const Range2T&) [with SequenceT = std::basic_string<char>; Range1T = std::basic_string<char>; Range2T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/common/util/functions.h:40:27: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp:47:52: warning: ‘this’ pointer is null [-Wnonnull]
47 | static void failed() { ((Model*)0)->constraints(); }
| ~~~~~~~~~~~~~~~~~~~~~~~~^~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/iter_find.hpp:26,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/split.hpp:16,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:23,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/concept.hpp:40:18: note: in a call to non-static member function ‘void boost::algorithm::FinderConcept<FinderT, IteratorT>::constraints() [with FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; IteratorT = __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >]’
40 | void constraints()
| ^~~~~~~~~~~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/assert.hpp:35,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept_check.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/concepts.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size_type.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/size.hpp:21,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/functions.hpp:20,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range_core.hpp:38,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/iterator_range.hpp:13,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/range/as_literal.hpp:22,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/trim.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:19,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp: In instantiation of ‘static void boost::concepts::constraint<Model>::failed() [with Model = boost::algorithm::FormatterConcept<boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >, boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>, __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > >]’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/find_format.hpp:104:13: required from ‘void boost::algorithm::find_format(SequenceT&, FinderT, FormatterT) [with SequenceT = std::basic_string<char>; FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; FormatterT = boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/replace.hpp:179:44: required from ‘void boost::algorithm::replace_first(SequenceT&, const Range1T&, const Range2T&) [with SequenceT = std::basic_string<char>; Range1T = std::basic_string<char>; Range2T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/common/util/functions.h:40:27: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/concept/detail/general.hpp:47:52: warning: ‘this’ pointer is null [-Wnonnull]
47 | static void failed() { ((Model*)0)->constraints(); }
| ~~~~~~~~~~~~~~~~~~~~~~~~^~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/iter_find.hpp:26,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/split.hpp:16,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string.hpp:23,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/graph/fragment/arrow_fragment.h:30,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/fragment/arrow_projected_fragment.h:36,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:20:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/boost/algorithm/string/concept.hpp:65:18: note: in a call to non-static member function ‘void boost::algorithm::FormatterConcept<FormatterT, FinderT, IteratorT>::constraints() [with FormatterT = boost::algorithm::detail::const_formatF<boost::iterator_range<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> > > >; FinderT = boost::algorithm::detail::first_finderF<__gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >, boost::algorithm::is_equal>; IteratorT = __gnu_cxx::__normal_iterator<const char*, std::basic_string<char> >]’
65 | void constraints()
| ^~~~~~~~~~~
In file included from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/dataframe.vineyard.h:38,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/dataframe.h:32,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/tensor_dataframe_builder.h:26,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/labeled_vertex_property_context.h:33,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/ctx_wrapper_builder.h:31,
from /home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc:34:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h: In instantiation of ‘class vineyard::TensorBaseBuilder<nonstd::sv_lite::basic_string_view<char> >’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.h:53:7: required from ‘class vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:352:26: required from ‘typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<long unsigned int> >::type gs::build_vy_tensor(vineyard::Client&, size_t, FUNC_T&&, int64_t) [with FUNC_T = gs::TransformUtils<gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>, void>::VertexDataToVYTensor(vineyard::Client&, const std::vector<grape::Vertex<long unsigned int>, std::allocator<grape::Vertex<long unsigned int> > >&)::<lambda(size_t)>&; typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<long unsigned int> >::type = boost::leaf::result<long unsigned int>; typename std::result_of<FUNC_T(long unsigned int)>::type = nonstd::sv_lite::basic_string_view<char>; size_t = long unsigned int; int64_t = long int]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:877:27: required from ‘boost::leaf::result<long unsigned int> gs::TransformUtils<FRAG_T, typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type>::VertexDataToVYTensor(vineyard::Client&, const std::vector<typename FRAG_T::vertex_t>&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type = void; typename FRAG_T::vertex_t = grape::Vertex<long unsigned int>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:393:7: required from ‘boost::leaf::result<long unsigned int> gs::VertexDataContextWrapper<FRAG_T, DATA_T>::ToVineyardTensor(const grape::CommSpec&, vineyard::Client&, const gs::Selector&, const std::pair<std::basic_string<char>, std::basic_string<char> >&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; DATA_T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:370:34: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h:190:11: error: no type named ‘ArrowType’ in ‘struct arrow::CTypeTraits<nonstd::sv_lite::basic_string_view<char> >’
190 | using ArrowTensorT =
| ^~~~~~~~~~~~
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h: In instantiation of ‘class vineyard::Tensor<nonstd::sv_lite::basic_string_view<char> >’:
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.h:62:36: required from ‘vineyard::TensorBuilder<T>::TensorBuilder(vineyard::Client&, const std::vector<long int>&) [with T = nonstd::sv_lite::basic_string_view<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.h:80:36: required from ‘vineyard::TensorBuilder<T>::TensorBuilder(vineyard::Client&, const std::vector<long int>&, const std::vector<long int>&) [with T = nonstd::sv_lite::basic_string_view<char>]’
/usr/include/c++/11/ext/new_allocator.h:162:4: required from ‘void __gnu_cxx::new_allocator<_Tp>::construct(_Up*, _Args&& ...) [with _Up = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}; _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >]’
/usr/include/c++/11/bits/alloc_traits.h:516:17: required from ‘static void std::allocator_traits<std::allocator<_Tp1> >::construct(std::allocator_traits<std::allocator<_Tp1> >::allocator_type&, _Up*, _Args&& ...) [with _Up = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}; _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; std::allocator_traits<std::allocator<_Tp1> >::allocator_type = std::allocator<vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> > >]’
/usr/include/c++/11/bits/shared_ptr_base.h:519:39: required from ‘std::_Sp_counted_ptr_inplace<_Tp, _Alloc, _Lp>::_Sp_counted_ptr_inplace(_Alloc, _Args&& ...) [with _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}; _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Alloc = std::allocator<vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> > >; __gnu_cxx::_Lock_policy _Lp = __gnu_cxx::_S_atomic]’
/usr/include/c++/11/bits/shared_ptr_base.h:650:16: [ skipping 3 instantiation contexts, use -ftemplate-backtrace-limit=0 to disable ]
/usr/include/c++/11/bits/shared_ptr.h:862:14: required from ‘std::shared_ptr<_Tp> std::allocate_shared(const _Alloc&, _Args&& ...) [with _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Alloc = std::allocator<vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> > >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}]’
/usr/include/c++/11/bits/shared_ptr.h:878:39: required from ‘std::shared_ptr<_Tp> std::make_shared(_Args&& ...) [with _Tp = vineyard::TensorBuilder<nonstd::sv_lite::basic_string_view<char> >; _Args = {vineyard::Client&, std::vector<long int, std::allocator<long int> >&, std::vector<long int, std::allocator<long int> >&}]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:309:54: required from ‘typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> > >::type gs::build_vy_tensor_builder(vineyard::Client&, size_t, FUNC_T&&, int64_t) [with FUNC_T = gs::TransformUtils<gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>, void>::VertexDataToVYTensorBuilder(vineyard::Client&, const std::vector<grape::Vertex<long unsigned int>, std::allocator<grape::Vertex<long unsigned int> > >&)::<lambda(size_t)>&; typename std::enable_if<((! std::is_same<typename std::result_of<FUNC_T(long unsigned int)>::type, grape::EmptyType>::value) && (! gs::is_dynamic<typename std::result_of<FUNC_T(long unsigned int)>::type>::value)), boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> > >::type = boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> >; typename std::result_of<FUNC_T(long unsigned int)>::type = nonstd::sv_lite::basic_string_view<char>; size_t = long unsigned int; int64_t = long int]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/utils/transform_utils.h:869:35: required from ‘boost::leaf::result<std::shared_ptr<vineyard::ITensorBuilder> > gs::TransformUtils<FRAG_T, typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type>::VertexDataToVYTensorBuilder(vineyard::Client&, const std::vector<typename FRAG_T::vertex_t>&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; typename std::enable_if<((! vineyard::is_property_fragment<T>::value) && (! gs::oid_is_dynamic<FRAG_T>::value))>::type = void; typename FRAG_T::vertex_t = grape::Vertex<long unsigned int>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:454:9: required from ‘boost::leaf::result<long unsigned int> gs::VertexDataContextWrapper<FRAG_T, DATA_T>::ToVineyardDataframe(const grape::CommSpec&, vineyard::Client&, const std::vector<std::pair<std::basic_string<char>, gs::Selector> >&, const std::pair<std::basic_string<char>, std::basic_string<char> >&) [with FRAG_T = gs::ArrowProjectedFragment<std::basic_string<char>, long unsigned int, std::basic_string<char>, long int>; DATA_T = std::basic_string<char>]’
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/core/context/vertex_data_context.h:423:34: required from here
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h:92:7: error: no type named ‘ArrowType’ in ‘struct arrow::CTypeTraits<nonstd::sv_lite::basic_string_view<char> >’
92 | using ArrowTensorT =
| ^~~~~~~~~~~~
/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/vineyard/basic/ds/tensor.vineyard.h:162:75: error: no type named ‘ArrowType’ in ‘struct arrow::CTypeTraits<nonstd::sv_lite::basic_string_view<char> >’
162 | __attribute__((annotate("shared"))) const std::shared_ptr<ArrowTensorT> ArrowTensor() {
| ^~~~~~~~~~~
cc1plus: note: unrecognized command-line option ‘-Wno-unused-lambda-capture’ may have been intended to silence earlier diagnostics
cc1plus: note: unrecognized command-line option ‘-Wno-undef-prefix’ may have been intended to silence earlier diagnostics
make[2]: *** [CMakeFiles/7a25f5c3aea0a9e650e1c2d75b9553d9f56ee666c310e0ce2b054488f029eb2c.dir/build.make:76: CMakeFiles/7a25f5c3aea0a9e650e1c2d75b9553d9f56ee666c310e0ce2b054488f029eb2c.dir/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/graphscope.runtime/include/graphscope/frame/app_frame.cc.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:83: CMakeFiles/7a25f5c3aea0a9e650e1c2d75b9553d9f56ee666c310e0ce2b054488f029eb2c.dir/all] Error 2
make: *** [Makefile:91: all] Error 2
2022-07-06 15:00:11,661 [ERROR][rpc:187]: Runstep failed with code: ANALYTICAL_ENGINE_INTERNAL_ERROR, message: Error occurred during preprocessing, The traceback is: Traceback (most recent call last):
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 623, in _RunStep
head, bodies = self.run_on_analytical_engine(
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 403, in run_on_analytical_engine
op, app_sig, app_lib_path = self._maybe_compile_app(op)
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 683, in _maybe_compile_app
compiled_path = self._compile_lib_and_distribute(
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 1411, in _compile_lib_and_distribute
app_lib_path, java_jar_path, java_ffi_path, app_type = compile_func(
File "/home/ubuntu/venvs/graphscope_test/lib/python3.8/site-packages/gscoordinator/utils.py", line 387, in compile_app
raise CompilationError(
graphscope.framework.errors.CompilationError: Failed to compile app grape::WCCAuto<_GRAPH_TYPE> on platform system: Linux
machine: x86_64
platform: Linux-5.15.0-1013-aws-x86_64-with-glibc2.35
uname: uname_result(system='Linux', node='ip-172-31-0-126', release='5.15.0-1013-aws', version='#17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022', machine='x86_64', processor='x86_64')
kernel_ver: #17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0\nCopyright (C) 2021 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.13
---------------------------------------------------------------------------
CompilationError Traceback (most recent call last)
Input In [1], in <cell line: 11>()
8 g = sess.g(oid_type="string")
9 g = g.add_edges(test_edges_path)
---> 11 context = graphscope.wcc(g)
12 context.to_dataframe(selector={'id': 'v.id', 'wcc': 'r'}, vertex_range={'begin': 1, 'end': 10}).sort_values(by='id', ascending=False)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/framework/app.py:76, in project_to_simple.<locals>.wrapper(*args, **kwargs)
74 else:
75 projected = graph
---> 76 return func(projected, *args[1:], **kwargs)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/framework/app.py:139, in not_compatible_for.<locals>._not_compatible_for.<locals>.wrapper(*args, **kwargs)
135 raise InvalidArgumentError(
136 "Not compatible for %s type" % " ".join(graph_types)
137 )
138 else:
--> 139 return not_compatible_for_func(*args, **kwargs)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/analytical/app/wcc.py:52, in wcc(graph)
27 @project_to_simple
28 @not_compatible_for("arrow_property", "dynamic_property")
29 def wcc(graph):
30 """Evaluate weakly connected components on the `graph`.
31
32 Args:
(...)
50 >>> sess.close()
51 """
---> 52 return AppAssets(algo="wcc", context="vertex_data")(graph)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/framework/app.py:313, in AppAssets.__call__(self, graph, *args, **kwargs)
311 def __call__(self, graph, *args, **kwargs):
312 """Instantiate an App and do queries over it."""
--> 313 app_ = graph.session._wrapper(AppDAGNode(graph, self))
314 return app_(*args, **kwargs)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/session.py:949, in Session._wrapper(self, dag_node)
947 def _wrapper(self, dag_node):
948 if self.eager():
--> 949 return self.run(dag_node)
950 return dag_node
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/session.py:971, in Session.run(self, fetches, debug)
952 def run(self, fetches, debug=False):
953 """Run operations of `fetches`.
954 Args:
955 fetch: :class:`Operation`
(...)
969 Different values for different output types of :class:`Operation`
970 """
--> 971 return self.run_fetches(fetches, debug)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/session.py:981, in Session.run_fetches(self, fetches, debug)
979 fetch_handler = _FetchHandler(self.dag, fetches)
980 try:
--> 981 response = self._grpc_client.run(fetch_handler.targets)
982 except FatalError:
983 self.close()
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/rpc.py:101, in GRPCClient.run(self, dag_def)
97 def run(self, dag_def):
98 runstep_requests = self._grpc_utils.generate_runstep_requests(
99 self._session_id, dag_def
100 )
--> 101 return self._run_step_impl(runstep_requests)
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/utils.py:155, in handle_grpc_error.<locals>.with_grpc_catch(*args, **kwargs)
153 while True:
154 try:
--> 155 return fn(*args, **kwargs)
156 except grpc.RpcError as exc:
157 code = exc.code()
File ~/venvs/graphscope_test/lib/python3.8/site-packages/graphscope/client/rpc.py:193, in GRPCClient._run_step_impl(self, runstep_requests)
187 logger.error(
188 "Runstep failed with code: %s, message: %s",
189 error_codes_pb2.Code.Name(response.code),
190 response.error_msg,
191 )
192 if response.full_exception:
--> 193 raise pickle.loads(response.full_exception)
194 return response
CompilationError: Failed to compile app grape::WCCAuto<_GRAPH_TYPE> on platform system: Linux
machine: x86_64
platform: Linux-5.15.0-1013-aws-x86_64-with-glibc2.35
uname: uname_result(system='Linux', node='ip-172-31-0-126', release='5.15.0-1013-aws', version='#17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022', machine='x86_64', processor='x86_64')
kernel_ver: #17-Ubuntu SMP Fri Jun 10 10:40:12 UTC 2022
mac_ver: ('', ('', '', ''), '')
gcc_ver: b'gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0\nCopyright (C) 2021 Free Software Foundation, Inc.\nThis is free software; see the source for copying conditions. There is NO\nwarranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.\n\n'
python_ver: 3.8.13
sighingnow
commented
2 years ago Should be the same issue posted in https://github.com/alibaba/GraphScope/issues/1753
Has been fixed in the vineyard side in https://github.com/v6d-io/v6d/pull/806 and will be included in the next release.
yyg192
commented
9 months ago Has this problem been resolved? The issue I encountered is same to this one graphscope 0.26.0 ubuntu20.04 python 3.8.13
Describe the bug Similar to issue #1753, GraphScope failed to compile app grape while running build-in graph algorithms.
To Reproduce
Expected behavior Output the result of wcc. All the nodes are in the same component.
Screenshots
Environment (please complete the following information):