MetOffice / XBTs_classification

Project for the classification of eXpendable Bathy Thermographs
BSD 3-Clause "New" or "Revised" License
4 stars 2 forks source link

Add bad data filtering and non-standard name mappings to preprocessing #14

Closed stevehadd closed 4 years ago

stevehadd commented 4 years ago

Initial data exploration has shown some previously unknown issues with the data. There are not many but they do cause problems for the explorations and classification code that are not easily resolved automatically. For now therefore we can simply exclude observations with these issues, so the code runs. Current issues:

stevehadd commented 4 years ago

Not sure when precisely this happened, but the dataset object is now dealing with these problems, mostly by just excluding the data.