cioos-siooc / ocean-data-parser

A Python package for parsing oceanographic proprietary data formats to xarray Dataset.
https://cioos-siooc.github.io/ocean-data-parser/
GNU General Public License v3.0
4 stars 1 forks source link

improve onset parser and assume only date format exist within a file #87

Closed JessyBarrette closed 4 months ago

JessyBarrette commented 4 months ago

Improve Onset data parser, this PR makes the parser relies on the pandas C parser instead of Python which should significantly reduce the time needed to parse a file.

The parser assume that the timestamp format is consistent accros a file. I believe this is true but it will be tested with the Hakai historical data.