randaller / llama-chat

Chat with Meta's LLaMA models at home made easy
GNU General Public License v3.0
834 stars 118 forks source link

Cuda Error on Training #31

Open masteryodaa opened 1 year ago

masteryodaa commented 1 year ago

I'm training the model with hf-training-exapmle.py. I have 24GB of GPU memory and still I'm getting the CUDA Out of Memory error. Please help.

I have tried decreasing the num_train_epochs size to 0.1 still not working.