CIGLR-ai-lab / GreatLakes-TempSensors

Collaborative repository for optimizing the placement of temperature sensors in the Great Lakes using the DeepSensor machine learning framework. Aiming to enhance the quantitative understanding of surface temperature variability for better environmental monitoring and decision-making.
MIT License
0 stars 0 forks source link

Get access and get familiar with U-M Turbo Research Storage #8

Closed DaniJonesOcean closed 3 months ago

DaniJonesOcean commented 4 months ago

Issue Description:

To facilitate our project's data storage needs, we have allocated space on U-M's Turbo Research Storage. This high-performance storage solution is designed to support large-scale research data and is accessible from the Great Lakes HPC, allowing for efficient work with large datasets.

As part of your onboarding, you will need to gain access to the Turbo Storage and become familiar with the system's capabilities and how to interact with the data stored there.

Task:

  1. Familiarize with Turbo Storage:

    • Review the Turbo Research Storage User Guide to understand the storage solution, its configuration, and best practices for usage.
  2. Access Turbo Storage:

    • You will be granted access to the Turbo volume assigned to our project. Familiarize yourself with the mount points and access methods relevant to your operating system and our project's work on the Great Lakes HPC.
    • You do not need to fill out any forms for initial access. Once you have a uniqname, I should be able to add you to our MCommunity Group seas-dannes-turbo, where our data lives.
  3. Test Access to Turbo Storage:

    • Once you have access, navigate to the storage volume /nfs/turbo/seas-dannes/SST-sensor-placement-input/ and verify that you can read and write to the space.
    • Understand a bit about the snapshot and replication features of the Turbo service.
  4. Explore Additional Support:

    • Consider engaging with the U-M Coderspaces for support and learning opportunities related to coding and data handling in this research environment.

Deliverable:

Resources:

Next Steps:

Following the successful setup of your access, we will proceed with utilizing the Turbo Storage for our data management needs as part of the GreatLakes-TempSensors project.

DaniJonesOcean commented 4 months ago

@eredding02 I have added your uniquname to seas-dannes-turbo, so you should have access to the Turbo Research Storage volume on which the project data is stored.

DaniJonesOcean commented 3 months ago

@eredding02 Feel free to close when you can access the data and have had a quick look at the user guide

eredding02 commented 3 months ago

@DaniJonesOcean I have successfully accessed the turbo research storage data for our project. I was able to open and view files via terminal and OnDemand. I still have some confusion surrounding "mount points" and what that entails.

DaniJonesOcean commented 3 months ago

Great! I'm glad it's working.

You won't need an in-depth understanding of mount points, so that's okay. In this case, it basically refers to how the HPC file system is connected to the Turbo storage system.