Open surnaik opened 1 month ago
Currently we do a check on data types and not push to velox if certain data type is present like array, map, etc. velox supports these datatypes, i think this can be supported. Any reason I'm not aware of why these types are currently not supported.
cc: @PHILO-HE @ulysses-you
cc @JkSelf
Velox parquet write doesn't flatten constant/dictionary encoding with complex type. You can refer here for more discussions.
Pending https://github.com/facebookincubator/velox/pull/9406 to fix.
Description
Currently we do a check on data types and not push to velox if certain data type is present like array, map, etc. velox supports these datatypes, i think this can be supported. Any reason I'm not aware of why these types are currently not supported.
cc: @PHILO-HE @ulysses-you