Add new options for goby_log_tool --format HDF5 to allow for RAM and disk space efficiency improvements:
--hdf5_chunk_length: Set to number of messages to process at a time and then write to an HDF5 "chunk" of this length. This will greatly reduce RAM usage on larger .goby files.
--hdf5_compression_level: Set to 0 (none) - 9 (max) to compress the HDF5 file chunks (must be used with --hdf5_chunk_length).
Add new options for
goby_log_tool --format HDF5to allow for RAM and disk space efficiency improvements:--hdf5_chunk_length: Set to number of messages to process at a time and then write to an HDF5 "chunk" of this length. This will greatly reduce RAM usage on larger .goby files.--hdf5_compression_level: Set to 0 (none) - 9 (max) to compress the HDF5 file chunks (must be used with --hdf5_chunk_length).