[pixels-cache] minor problems in pixels cache

pixelsdb / pixels

An efficient storage and compute engine for both on-prem and cloud-native data analytics.

GNU Affero General Public License v3.0

139 stars 37 forks source link

Closed bianhq closed 2 months ago

bianhq commented 2 months ago

[x] cache plan generation replies on storage.listStatus() instead of the file information in the metadata service.
[x] The cache writer does not cache the tail file containing fewer row groups than the compact factor.

bianhq commented 2 months ago

The tail file containing fewer row groups than the compact factor can not be cached as it is not compatible with the cache layout.