Closed dhdaines closed 2 years ago
CycleCloud does not seem to actually work (or, perhaps, it is just Enterprise Grade Java Software which silently fails if you don't run it on a big enough machine) so I don't think that'll go in here.
On the other hand, it is somewhat feasible for a mere mortal like myself to set up a SLURM cluster on Google Compute Engine, if they avoid reading Google's useless documentation and burning their eyes out looking at the Terraform website.
You can also buy a pile of old computers and install Debian or Ubuntu on them, which will actually be more efficient than all of this DevelOpEr Pr0dUCtiVity eNhanCIng CloUD N4TivE ifNasTRucTUre and has the side benefit of ensuring your privacy, data sovereignty, etc. So there will definitely be instructions for that.
A basic template for training librispeech-clean-100 as a PTM model on a single machine.
Still a work in progress, may acquire the following features: