Library is doing unbuffered reads

julienbt / netcdf3

A pure Rust library for reading and writing NetCDF-3 files

Apache License 2.0

1 stars 1 forks source link

Open torkleyy opened 1 year ago

torkleyy commented 1 year ago

The performance of functions such as FileReader::read_var is quite poor because the reads are all unbuffered.

torkleyy commented 1 year ago

I've had success replacing the File in FileReader with a Cursor<Vec<u8>>, but obviously that will only work for files that fit in RAM 😄

julienbt commented 9 months ago

Hello @torkleyy

Thank you for your interest in the library.

Apologies for my lack of responsiveness. I will have more time in the coming weeks (during the Christmas holidays) to work on the various issues.

Indeed, it could be interesting to be able to buffer input files to improve reading performance.

Of course, it will be necessary to maintain the ability to read large files.