JuliaData / Feather.jl

Read and write feather files in pure Julia
https://juliadata.github.io/Feather.jl/stable
Other
109 stars 27 forks source link

why padding? #74

Closed ExpandingMan closed 6 years ago

ExpandingMan commented 6 years ago

I've been working on rewriting Feather with my new Apache Arrow Implementation and a new version of Feather version for implementing it (still working, will document and request comments once I have the new Feather completely up and working with Arrow), and one thing I have been noticing is that it doesn't actually seem that the Feather format requires any padding whatsoever. Also, as far as I can tell everything seems to pretty much just work if all of the padding is removed. What is the reason for the padding? Is there some benefit?

quinnj commented 6 years ago

https://github.com/apache/arrow/blob/master/format/Layout.md#alignment-and-padding

ExpandingMan commented 6 years ago

Hm, that's embarrassing on my part as obviously I should have known that, but for some reason I could have sworn that this was optional...