aloneguid / parquet-dotnet

Fully managed Apache Parquet implementation

https://aloneguid.github.io/parquet-dotnet/

MIT License

600 stars 151 forks source link

Ensuring delta encoding footer blocks are complete And Handle Overflow #387

Closed ee-naveen closed 1 year ago

ee-naveen commented 1 year ago

Ensuring delta encoding footer blocks are complete
- backward compatible for polars, data bricks warehouse etc.
Handle Overflow: Using MSB position to calculate bit width
- Issue: https://github.com/aloneguid/parquet-dotnet/issues/389
- ref : parquet-mr : https://github.com/apache/parquet-mr/blob/master/parquet-column/src/main/java/org/apache/parquet/column/values/delta/DeltaBinaryPackingValuesWriterForInteger.java#L152

eeabhishekmore commented 1 year ago

375