I have a data logger on an embedded device that writes data to parquet using this library. Currently, if my app crashes or my machine loses power, then I lose all my data, since the parquet data is not finalized until I call WriteStop(). Is it possible to flush data mid way through writing, in such a way that I will be able to read it later even if my app crashes or my device loses power before I call WriteStop()?
I have a data logger on an embedded device that writes data to parquet using this library. Currently, if my app crashes or my machine loses power, then I lose all my data, since the parquet data is not finalized until I call WriteStop(). Is it possible to flush data mid way through writing, in such a way that I will be able to read it later even if my app crashes or my device loses power before I call WriteStop()?