Rewrite logic to get cluster config + update for getting slurm logs + remove caching

Kipok / NeMo-Skills

A pipeline to improve skills of large language models

https://kipok.github.io/NeMo-Skills/

Apache License 2.0

185 stars 41 forks source link

Rewrite logic to get cluster config + update for getting slurm logs + remove caching #140

Closed Kipok closed 1 month ago

Kipok commented 1 month ago

The slurm logs logic is to enable nemo run commands for getting the logs. Will work after https://github.com/NVIDIA/NeMo-Run/pull/69 is merged (but doesn't break anything, so we don't need to wait for that PR)