Closed KevinyhZou closed 9 months ago
The problem is described in issue https://github.com/oap-project/gluten/issues/3908, the memcmp in ColumnNullable's function insertRangeSelective will decrease the shuffle write performance, and after remove the memcmp logical, the shuffle write performance improve as described in pr https://github.com/oap-project/gluten/pull/3909
ColumnNullable
insertRangeSelective
memcmp
Information about CI checks: https://clickhouse.com/docs/en/development/continuous-integration/
Can one of the admins verify this patch?
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
The problem is described in issue https://github.com/oap-project/gluten/issues/3908, the memcmp in
ColumnNullable
's functioninsertRangeSelective
will decrease the shuffle write performance, and after remove thememcmp
logical, the shuffle write performance improve as described in pr https://github.com/oap-project/gluten/pull/3909Documentation entry for user-facing changes