Closed samsja closed 1 year ago
save_pretrained from peft double the memory consumption of the video ram when saving the model to disk. THis is a problem with falcon 40b because it always lead to oom
Context
save_pretrained from peft double the memory consumption of the video ram when saving the model to disk. THis is a problem with falcon 40b because it always lead to oom