Closed vlahm closed 4 years ago
@vlahm This can sometimes happen in cases where we've discovered location data were in error, and we've had to update the database. It's different from the situation where a sensor actually moved, those changes are tracked in the start and end dates. In this case the locations were corrected in between processing of the 2020-02 and 2020-03 data.
loadByProduct() does try to handle this, by retaining only the sensor_positions file with the most recent publication date. But if you download multiple months of data separately, as you did in the code you showed, you can still run into it. You can do the same check manually, using the publicationDate column in the sensor_positions file, and rely on the file with the most recent date.
We're prepping for a complete re-processing of all instrumented data later this year, which will clean up these discrepancies. Our infrastructure doesn't currently allow for on-the-fly re-processing and re-publication when metadata are updated, but that's something we're also looking into for the future.
This makes sense. Thank you!
Function LoadByProduct
Describe the bug Depending on the sitemonth requested, different (conflicting) sensor position data is returned.
To Reproduce