search

leap-stc / data-management

Collection of code to manually populate the persistent cloud bucket with data
https://catalog.leap.columbia.edu/
Apache License 2.0
0 stars 6 forks source link

New Dataset - Idealised ocean channel model with peninsulas #169

Open RachelFurner opened 3 weeks ago

RachelFurner commented 3 weeks ago

Dataset Name

ocean channel model with peninsulas

Dataset URL

No response

Description

This file is output from a highly idealised run of MITgcm, using a channel model configuration with two land peninsulas and idealised forcing. The configuration was used for a soon to be published paper. While highly idealised, the configuration contains realistic ocean dynamics. As such, it provides a nice testbed for machine learning approaches, without the computational overhead of a full ocean-dataset.

Size

Single file, size 394GB

License

Creative Comms

Data Format

NetCDF

Data Format (other)

No response

Access protocol

FTP

Source File Organization

There is one very big file. This contains 50 years of data at 12 hourly outputting. The grid is 240 by 105 by 38. It could be ncks'ed it into temporal chunks if needed. Variables contained are potential temperature, Sea surface height, zonal and meridional components of currents, Temperature forcing, and zonal wind stress (the highly idealised nature of the configuration means meridional wind stress is zero in all locations and at all times).

Example URLs

No response

Authorization

None

Transformation / Processing

The file should be useable as is.

Target Format

Zarr

Comments

No response

norlandrhagen commented 3 weeks ago

Hey there @RachelFurner, do you have a link to the NetCDF file?

RachelFurner commented 2 days ago

Hi Raphael,

So sorry for the slow response.

I don't have a link - I've not managed to find anywhere to store the data previously, so just have it on my old institution's hpc. I should be able to ftp it, or upload etc, if you have somewhere suitable.

Thanks, Rachel

On Fri, 1 Nov 2024 at 21:31, Raphael Hagen @.***> wrote:

Hey there @RachelFurner https://github.com/RachelFurner, do you have a link to the NetCDF file?

— Reply to this email directly, view it on GitHub https://github.com/leap-stc/data-management/issues/169#issuecomment-2452619578, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALOCO6FOS2IZGZKVWBR2CMTZ6PXMXAVCNFSM6AAAAABRA7FDDOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINJSGYYTSNJXHA . You are receiving this because you were mentioned.Message ID: @.***>

norlandrhagen commented 2 days ago

Hey Rachel,

No worries! Yeah, if you can transfer it to a leap bucket, that would be ideal. There are some docs for using rclone with leap here. I can get you credentials for the source bucket when you're ready.