openbikesensor / portal

OpenBikeSensor data collection portal
GNU Lesser General Public License v3.0
37 stars 17 forks source link

More robust CSV-Reader #308

Open BenediktAllendorf opened 1 year ago

BenediktAllendorf commented 1 year ago

Currently, as soon as there are broken lines (random binary data) within the CSV file, it cannot be imported at all. E.g., those lines can appear whenever the sensor isn't shut down correctly, leading to corrupt data being written.

I suggest just ignoring corrupt lines and extracting measurements from the valid lines. This can be done fairly easily in read_csv(), but I wonder whether this isn't done on purpose or if there is any reason to not do this?