aodn / content

Tracks AODN Portal content and configuration issues
0 stars 0 forks source link

GSLA NRT fails to aggregate #519

Closed leonardolaiolo closed 7 months ago

leonardolaiolo commented 7 months ago

We've encountered issues that I believe are related to inconsistent variables within the GSLA NRT collection. Specifically, when users attempt to aggregate data in the AODN portal with date ranges spanning both pre and post 2021-10-07, the inconsistency causes aggregation to fail.

IMOS_OceanCurrent_HV_20210910T000000Z_GSLA_FV02_NRT.nc was recently re-uploaded by teh facility but it lacks a couple of variables present in other files (start_time and end_time). I believe these missing variables trigger aggregation errors when this file is included. Uploading a consistent version of this file should resolve the issue for that specific file.

Additionally, concerning the two variables UCUR_MEAN and VCUR_MEAN, for successful aggregation, these should be included in all files within the NRT collection, including those pre-dating 2021-10-07. To fix this, facility should reprocess and re-upload all affected files. For now, we can redirect users that have issues to Thredds to download single files. However, the AODN Portal's aggregation tool will continue to encounter failures due to inconsistent variables. I think other potential solutions might involve hiding old (pre 2021-10-07) files or restricting their availability.

A meeting with the facility has been proposed for early 2025 to see how to fix this now and for future data upload.