Open tripathiarpan20 opened 8 months ago
The number of epochs is hardcoded to 10000, but we manually stopped training at 53. Which batch size are you using for training on the H100?
As for efficiently fine-tuning from G_500000.pt: the training procedure should be the same as starting from an untrained checkpoint, and from my informal experience should be slightly quicker to converge.
Hi! Thanks for the open-source work.
I tried training an LLVC with a custom voice using a pretrained model from weights.gg, however, there were several discrepancies that lead to failure in reproduction of the results:
experiments/llvc/config.json
, with only thelog_interval
andcheckpoint_interval
altered). This is way off as compared to the information in the paper claiming a training time of 3 days on RTX 3090 (for 500000 steps), any suggestions to fix the same?:G_500000.pth
checkpoint in a parameter efficient manner that can be open-sourced?