CIGLR-ai-lab / GreatLakes-TempSensors

Collaborative repository for optimizing the placement of temperature sensors in the Great Lakes using the DeepSensor machine learning framework. Aiming to enhance the quantitative understanding of surface temperature variability for better environmental monitoring and decision-making.
MIT License
0 stars 0 forks source link

Learn and understand the data format called 'NetCDF' and its applications #11

Closed DaniJonesOcean closed 3 months ago

DaniJonesOcean commented 4 months ago

Issue Description:

NetCDF (Network Common Data Form) is a foundational format for representing array-oriented scientific data that we will be using in our GreatLakes-TempSensors project. This issue is dedicated to learning the fundamentals of NetCDF, understanding its self-describing nature (yay, metadata!), and recognizing its role in facilitating data sharing within the scientific community.

Readings and Exploration:

Task Objectives:

Deliverable:

Resources:

After completing this issue, you'll have a fundamental understanding of the NetCDF format and be prepared to apply this knowledge to interpret and manipulate our project's datasets.

eredding02 commented 3 months ago

@DaniJonesOcean Network Common Data Form(NetCDF) was created to handle information from Earth sciences in the form of related arrays. It handles a number of key "dimensions" or axes that define the shape of the data, we may use latitude, longitude, and time. "Variables" contain data in accordance with information from all or some of the dimensions. For example, we would have surface temperature as a variable—a function of latitude, longitude, and time. We could also use lake depth as a variable, which would only relate to lat and long. "Attributes" hold various pieces of metadata. Along with being useful for environmental data, NetCDF is self-describing, portable, scalable, appendable, shareable, and archivable. It is able to be used with Linux, OSX, Windows with a number of languages like Python, Java, C++, Matlab, etc.

I found this YouTube video useful

DaniJonesOcean commented 3 months ago

Great! Feel free to close this issue when you're ready