apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.
https://hudi.apache.org/
Apache License 2.0
5.24k stars 2.39k forks source link

[SUPPORT] The query result of the partition column as the filter condition is incorrect #10692

Closed fanfanAlice closed 5 months ago

fanfanAlice commented 5 months ago

Tips before filing an issue

Describe the problem you faced

A clear and concise description of the problem.

To Reproduce

Steps to reproduce the behavior:

  1. use spark-sql create hudi table
  2. insert into table
  3. select table image

Expected behavior

A clear and concise description of what you expected to happen.

Environment Description

Additional context

Add any other context about the problem here.

Stacktrace

Add the stacktrace of the error.

  1. create table hudi_test.hudi_cow_pt_tbl6 ( id bigint, name string, ts bigint, dt date, hh string ) using hudi tblproperties ( type = 'cow', primaryKey = 'id', preCombineField = 'ts' ) partitioned by (dt) location 'hdfs://cdp716-master01.kylin.com:8020/user/hive/warehouse/hudi_test.db/hudi_cow_pt_tbl6';

  2. insert into hudi_cow_pt_tbl6 select 1 as id, 'a0' as name, 1000 as ts, cast('2021-12-10' as date) as dt, '10' as hh;
  3. execute: select dt,hh from hudi_test.hudi_cow_pt_tbl6 where dt = '2021-12-10'; result is null, but use hh filter result is success.
ad1happy2go commented 5 months ago

@fanfanAlice I was able to experiment and confirm this issue in 0.13.0 but it got fixed with version 0.13.1. So I suggest you to upgrade to 0.13.1 OR 0.14.X release.

fanfanAlice commented 5 months ago

I upgraded to hudi version 0.13.1 and the issue has been resolved thank you very much

ad1happy2go commented 5 months ago

Thanks @fanfanAlice . Closing this issue then.