search

yu-jeffy / GreedLlama

1 stars 0 forks source link

Polish LLaMa 2 Fine-Tuning Pipeline #13

Open yu-jeffy opened 7 months ago

yu-jeffy commented 7 months ago

Realized i was using llama 7b, not llama 7b chat 🤦

starting again

yu-jeffy commented 7 months ago

changed checkpoint saves from every 50 steps to 800 or 2000 steps

each checkpoint takes 500mb+ to store, eats up disk space doing it every 50