varchar-io / nebula

A distributed block-based data storage and compute engine
https://nebula.bz
Apache License 2.0
154 stars 18 forks source link

Certain tables causing OOM even when retention is set very low #163

Open ritvik-statsig opened 2 years ago

ritvik-statsig commented 2 years ago

For certain tables, I have noticed that nodes will OOM on loading data even when retention is set very low. This doesn't make sense to me, feels like there must be an issue. Will send some example parquet files when you're working on this.

shawncao commented 2 years ago

@ritvik-statsig Do you have an example of config/test data to repro this?