hardware requirements to run finetune

VinAIResearch / PhoGPT

PhoGPT: Generative Pre-training for Vietnamese (2023)

Apache License 2.0

739 stars 67 forks source link

hardware requirements to run finetune #26

Closed trung-nw closed 5 months ago

trung-nw commented 5 months ago

I ran the sample finetune with default settings on Nvidia A100 40Gb but got OOM. can we get finetune successfully on Nvidia A100 40Gb hardware? any updates for the settings to get it. thank you.

datquocnguyen commented 5 months ago

Yes, A100 40GB is more than enough to do full-weight fine-tuning of the 4B model. That's what I have been using.