Closed drxmy closed 1 year ago
I saw there is a branch with bitfit and wonder how much VRAM it will use to fintune bloom-176b. @Muennighoff
Thank you
Hey! Not sure about how much VRAM it will use, but i'd guess somewhere like 10 - 40% less than the full parameter training.
Thank you!
I saw there is a branch with bitfit and wonder how much VRAM it will use to fintune bloom-176b. @Muennighoff
Thank you