There is no operator<< overload in Parquet's stream_writer.h that accepts std::vector<uint_8> or similar such that data is written with converted type "none". It would be useful to have this.
Inheriting the existing StreamWriter class and using its WriteVariableLength protected function isn't possible currently as it enforces UTF-8:
This is also undocumented. Requires looking at the sources to see that StreamWriter can only write UTF8. Makes it impossible to write binary data that will be then correctly read by e.g. Polars (Python).
Describe the enhancement requested
There is no
operator<<
overload in Parquet'sstream_writer.h
that acceptsstd::vector<uint_8>
or similar such that data is written with converted type "none". It would be useful to have this.Inheriting the existing StreamWriter class and using its
WriteVariableLength
protected function isn't possible currently as it enforces UTF-8:https://github.com/apache/arrow/blob/91ee6dad722ee154d63eea86ce5644e1e658b53b/cpp/src/parquet/stream_writer.cc#L143-L145
Component(s)
C++, Parquet