search

StormSurgeLive / asgs

The Automated Solution Generation System (ASGS) provides software infrastructure for automating coastal ocean modelling for real time decision support, and provides a variety of standalone command line tools for pre- and post-processing. Visit us at https://discord.gg/jFbacxrUf9
https://tools.adcirc.live
GNU General Public License v3.0
39 stars 22 forks source link

Automated Resource Monitoring for Heartbeat integration #316

Closed carolakaiser closed 2 years ago

carolakaiser commented 4 years ago

In the ASGS Weekly Call meeting notes from 20200618, the options for automated command line allocation and disk quota checks on the hpc clusters were described. Is it possible to integrate this into ASGS and write the info back into the run.properties file with each ASGS run. It would be valuable to have this information available on the Heartbeat website for monitoring purposes.

wwlwpd commented 4 years ago

@carolakaiser can you or someone in your group provide the technical details about the integration. I was never quite clear how ASGS is supposed to get the data there. I seem to recall it was a python script, but I am not sure if that has been made available. If so, my suggestion is to:

  1. have someone create a branch that adds it to ./monitoring, update this issue with the branch's location
  2. update this GH issue with information on how to run it and ideally how frequently
  3. information on external dependencies (inc python modules & versions), etc in case we have to be sure to install those python modules (or whatever) when ASGS is installed or updated

Thanks!

wwlwpd commented 4 years ago

I do have some "soft" expectations that:

carolakaiser commented 2 years ago

This may probably not be a task for the nearer future.