Closed taiyang-li closed 1 year ago
Close https://github.com/oap-project/gluten/issues/1914
原来的实现:当将arrow column转化为ch column时,如果arrow type是负责类型(list/map/struct), 则不抽取arrow column的null map, 因为ch中复杂类型都是非nullable的。
现在的实现:为了保持与gluten兼容,即允许复杂类型为nullable, 修改代码,使得arrow type为复杂类型时,依然抽取null map和data column, 构成对应ch的nullable column
Can one of the admins verify this patch?
@baibaichen @liuneng1994 @binmahone can you review this pr
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Close https://github.com/oap-project/gluten/issues/1914
原来的实现:当将arrow column转化为ch column时,如果arrow type是负责类型(list/map/struct), 则不抽取arrow column的null map, 因为ch中复杂类型都是非nullable的。
现在的实现:为了保持与gluten兼容,即允许复杂类型为nullable, 修改代码,使得arrow type为复杂类型时,依然抽取null map和data column, 构成对应ch的nullable column