Code up workflow for quick, "local" download of WOD required for CARSv2

[Thomas-Moore-Creative]

Code up workflow for quick, "local" download of WOD required for CARSv2

requirements

• years: 2000 onward
• platforms: all

[BecCowley]

@Thomas-Moore-Creative I have copied IQuOD files onto Gadi and have been able to read them and plot very quickly with NCI VM 2 cores. Much quicker than files located on Bowen storage and trying to use code sitting on tube-hba which is located in Hobart.

[Thomas-Moore-Creative]

Nice work @BecCowley

It's always exciting when you get your compute and your data right next to each other.

Don't get me started on what has happened to Bowen storage.

[Thomas-Moore-Creative]

@BecCowley (and @ChrisC28 ) - so do we think this issue is resolved? We plan to bring WOD data in via Gadi and then can transfer to other platforms / locations as needed?

• How big is "everything" WOD?
• What is the list of platforms / locations we'll need to get the data to?

Assume list includes machines on site in Hobart? Do we need data on Canberra Bowen to utilise CSIRO HPC?

[BecCowley]

Might be useful: argopy libraries use DataFetcher https://github.com/euroargodev/argopy

[Thomas-Moore-Creative]

looks like, for now, @ChrisC28 has WOD2018 downloaded - https://github.com/CARSv2/cars-v2/issues/20#issuecomment-2111431289

[Thomas-Moore-Creative]

Closing this as @ChrisC28 completed