Closed sa5r closed 2 years ago
I'm trying to run the pre-train script on a server that has no GPU, would that be possible?
At least for now, It is difficult to train a large LM on CPU-only servers. But you can run the pre-training script on CPU-only servers for debugging.
I'm trying to run the pre-train script on a server that has no GPU, would that be possible?