Wrong grid for ACORN HF CBG Hourly QC dataset

[ocehugo]

Problem: We still got some files with a different grid for the ACORN CBG collection. This is blocking the aggregation service, since the grid on those files is different from others. Blame files are between 2008-06-02 and 2008-06-12 and were uploaded in Oct/2015.

Solution: Re-upload corrected files.

@scosoli, may you check/reupload the files below!?

Files below do not follow the standard Lon/lat grid dimensions:

dimensions:
        LATITUDE = 64 ;
        LONGITUDE = 72 ;

List :

IMOS_ACORN_V_20080602T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080603T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080604T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080605T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080606T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080607T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080608T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080609T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080610T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T043000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T053000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T063000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T073000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T083000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T093000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T103000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T113000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T123000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T133000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T143000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T153000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T163000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T173000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T183000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T193000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T203000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T213000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T223000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080611T233000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080612T003000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080612T013000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080612T023000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080612T033000Z_CBG_FV01_1-hour-avg.nc
IMOS_ACORN_V_20080612T043000Z_CBG_FV01_1-hour-avg.nc

[scosoli]

we are aware of the problem and need to regrid data on the proper grid. these files were not generated @ UWA but @ emii and have several issues, including non-up-to-date Conventions (CF-1.5,IMOS-1.2) and non consistent QC tests - flags

[scosoli]

same would apply for COF data, while all data for ROT, SAG, TURQ have been upgraded recently

[ocehugo]

@scosoli , thanks for the quick reply.

I will update the title to include COF too. Let me know if you need anything from us.

[scosoli]

thanks hugo - my only question would be, by when would you need the updated data available? will prioritise this task over others if needed

[ocehugo]

@scosoli,

I just checked and apparently the COF dataset can be aggregated - Hence, no grid problems. I'm removing it from the title to avoid confusion. Did you mean COF only need convention updates? If so, I think a new issue is the best thing to do.

my only question would be, by when would you need the updated data available? will prioritise this task over others if needed

it's not my call to define priority - @ggalibert!?

[ggalibert]

If I understand well this corresponds to 10 days of data that needs re-processing by the facility. It is quite small so maybe not necessarily a high priority but in the meantime it is breaking the aggregation service from the portal: any aggregation request for this site that includes [2008-06-02; 2008-06-12] will fail.

@scosoli , would that be OK to remove these files from THREDDS/S3 (we can still keep a copy somewhere) while we're waiting for you to provide us with re-processed datasets? You could prioritise this task to whenever would work best for you.

[scosoli]

let me download these data first then you can remove access from thredds/S3. will notify you when done. We've found something funny on DM FV01 WERA radials after 201711070415 for all WERA sites, too. will open a separate ticket

[scosoli]

There is a couple of issues here with the DM data set. 1, the same grid inconsistency is also found for RT data; 2, the grid seems to randomly change from dimension 80x80 to 64x72 for RT data 3, the FV01 DM data gridded on the 80x80 grid do not make sense. there is a clear mistake during the reshaping of a matrix. see attached godiva maps for the same data, the first for RT and the second for DM data

[scosoli]

[scosoli]

sorry, attached the same plot twice. the correct image for the 'wrong' DM FV01 is below:

[scosoli]

the pattern shown in the second (third) plot is consistent within the entire time frame listed by @ocehugo above. @ggalibert I think you should remove with no hesitation the FV01 data while we fix them from scratch.

FYI: I found the same issue at other nodes (TURQ, for instance), but I had the chance to reprocess (and regrid) data consistently

[ocehugo]

Thanks @scosoli.

FV01 Affected files unindexed & removed.

PS: I assume the FV00 would be re-uploaded/overwritten together with the new FV01!? I didn't remove since they don't break anything but I'm willing to do so if helps to maintain consistency.

[scosoli]

@ocehugo , yes, I will update also FV00 because they need to be regridded for consistency with other FV00 products.

[scosoli]

@ocehugo, FV01 data for the subset listed above have ben regridded, QC'd and are ready to be uploaded. however, there may be an inconsistency before/after 2014q1 - not in terms of grid size but rather in terms of flipped dimensions. data need to be flipped upside/down (latitude), and left/right (longitude, GDOP, UCUR/VCUR, UCUR_sd/VCUR_sd, NOBS1/NOBS2, UCUR_quality_control/VCUR_quality_control. data can still be concatenated with ncrcat with no errors but aggregation would produce inconsistent results. It would be better also to run the full QC set to the entire record - has been done only for TURQ, ROT, SAG, BONC, not yet for CBG and COF. will do asap

[ocehugo]

@scosoli, thanks for the heads up.

1. I cannot locate the above files or logs of the upload. Did you really upload!?

2. IMO, you may wait to upload the entire record reprocessed. I think if the files are inconsistent with the rest it may cause more problems for the end-user than having no files.

PS: We don't use ncrcat for aggregation but java libraries. I think that if the files are inconsistent as you describe the aggregation will continue to fail or produce the same results you experienced with ncrcat.

[scosoli]

hello @ocehugo , no I have not uploaded files yet. was waiting for some feedback. will reprocess all data consistently so to avoid possible issues with concatenation and also make sure all data are QC'd consistently.

[scosoli]

@ocehugo, FV01 data for the time period (2007q4 to 2013q3), and also the files listed above, are ready for upload to the portal. will soon start uploading

[scosoli]

@ocehugo @ggalibert , all data for the time period 2007Q4 to 2013Q4 are currently being uploaded (including the dataset listed here). grid issues should be fixed now and all data QC'd consistently with updated conventions and QC flags

[ocehugo]

@scosoli - I'm watching it and will verify tomorrow if we got any problems along the way.

thanks

[ocehugo]

update: I will check again on Monday - still about ~20hours to go given every file is taking about ~3sec.

[scosoli]

@ocehugo I believe all files have been uploaded. I did some aggregation tests and everything seems to be working fine. if you confirm this too, I think we can close this issue

[ocehugo]

Yeap - all good. I tested earlier this week but forgot to reply here.

Thanks