apache / incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
https://gluten.apache.org/
Apache License 2.0
1.15k stars 416 forks source link

[CH] TPCDS q14b Type mismatch of columns to JOIN #4873

Open liujiayi771 opened 6 months ago

liujiayi771 commented 6 months ago

Backend

CH (ClickHouse)

Bug description

24/03/06 23:16:23 WARN [task-result-getter-1] TaskSetManager: Lost task 3.0 in stage 412.0 (TID 56244) (core-1-6.c-59962a4a9d28d8c9.cn-hangzhou.emr.aliyuncs.com executor 6): io.glutenproject.exception.GlutenException: Type mismatch of columns to JOIN by: i_brand_id#40998 :: Int32 at left, store_8 :: String at right
0. /mnt/disk1/code/github/gluten/cpp-ch/build/./src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000601b4bb in /opt/apps/ch/libch.so
1. ./contrib/llvm-project/libcxx/include/string:1499: DB::Exception::Exception<String const&, String, String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type, std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&, String const&, String&&) @ 0x000000000f4f6301 in /opt/apps/ch/libch.so
2. /mnt/disk1/code/github/gluten/cpp-ch/build/./src/Interpreters/JoinUtils.cpp:0: DB::JoinCommon::checkTypesOfKeys(DB::Block const&, std::vector<String, std::allocator<String>> const&, DB::Block const&, std::vector<String, std::allocator<String>> const&) @ 0x000000000f8356e9 in /opt/apps/ch/libch.so
3. ./contrib/llvm-project/libcxx/include/__iterator/wrap_iter.h:158: DB::HashJoin::checkTypesOfKeys(DB::Block const&) const @ 0x000000000f325582 in /opt/apps/ch/libch.so
4. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815: DB::JoiningTransform::transformHeader(DB::Block, std::shared_ptr<DB::IJoin> const&) @ 0x000000001015ebb0 in /opt/apps/ch/libch.so
5. /mnt/disk1/code/github/gluten/cpp-ch/build/./src/Processors/QueryPlan/JoinStep.cpp:104: DB::JoinStep::updateOutputStream() @ 0x00000000102a62e4 in /opt/apps/ch/libch.so
6. /mnt/disk1/code/github/gluten/cpp-ch/build/./src/Processors/QueryPlan/JoinStep.cpp:50: DB::JoinStep::JoinStep(DB::DataStream const&, DB::DataStream const&, std::shared_ptr<DB::IJoin>, unsigned long, unsigned long, bool) @ 0x00000000102a496c in /opt/apps/ch/libch.so
7. ./contrib/llvm-project/libcxx/include/string:1570: local_engine::JoinRelParser::parseJoin(substrait::JoinRel const&, std::unique_ptr<DB::QueryPlan, std::default_delete<DB::QueryPlan>>, std::unique_ptr<DB::QueryPlan, std::default_delete<DB::QueryPlan>>) @ 0x00000000062c81d6 in /opt/apps/ch/libch.so
8. /mnt/disk1/code/github/gluten/cpp-ch/build/./utils/extern-local-engine/Parser/JoinRelParser.cpp:154: local_engine::JoinRelParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x00000000062c35c9 in /opt/apps/ch/libch.so
9. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x0000000006336611 in /opt/apps/ch/libch.so
10. /mnt/disk1/code/github/gluten/cpp-ch/build/./utils/extern-local-engine/Parser/RelParser.cpp:70: local_engine::RelParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x00000000062e84f8 in /opt/apps/ch/libch.so
11. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x0000000006336611 in /opt/apps/ch/libch.so
12. /mnt/disk1/code/github/gluten/cpp-ch/build/./utils/extern-local-engine/Parser/RelParser.cpp:70: local_engine::RelParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x00000000062e84f8 in /opt/apps/ch/libch.so
13. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x0000000006336611 in /opt/apps/ch/libch.so
14. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:303: local_engine::SerializedPlanParser::parseOp(substrait::Rel const&, std::list<substrait::Rel const*, std::allocator<substrait::Rel const*>>&) @ 0x0000000006336c79 in /opt/apps/ch/libch.so
15. /mnt/disk1/code/github/gluten/cpp-ch/build/./utils/extern-local-engine/Parser/SerializedPlanParser.cpp:0: local_engine::SerializedPlanParser::parse(String const&) @ 0x000000000634816d in /opt/apps/ch/libch.so
16. /mnt/disk1/code/github/gluten/cpp-ch/build/./utils/extern-local-engine/local_engine_jni.cpp:277: Java_io_glutenproject_vectorized_ExpressionEvaluatorJniWrapper_nativeCreateKernelWithIterator @ 0x0000000005fb98e6 in /opt/apps/ch/libch.so

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

No response

liujiayi771 commented 6 months ago

cc @zzcclp