search

delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
2.33k stars 411 forks source link

perf: early stop if all values in arr are null #2764

Closed ion-elgreco closed 3 months ago

ion-elgreco commented 3 months ago

Description

We can stop a bit earlier when all values in the array are null by just grabbing the null count from nullbuffer.