Open RuoyiDu opened 1 year ago
Excellent work! How much memory is needed to run this code (train and inference)?
Hi @RuoyiDu,
It requires ~15GB of memory in most cases. You can also decrease batch_size or use fp16 mode to further reduce memory usage.
Excellent work! How much memory is needed to run this code (train and inference)?