search

unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
18.59k stars 1.3k forks source link

`_fast_inner_training_loop` has ZeroDivisionError #1109

Closed fzyzcjy closed 1 month ago

fzyzcjy commented 1 month ago

Stack:

  File "my_file_name.py", line 68, in train
    self.inner.train()
  File "<string>", line 142, in train
  File "<string>", line 29, in _fast_inner_training_loop
ZeroDivisionError: integer division or modulo by zero
fzyzcjy commented 1 month ago

Ok find it is unrelated to unsloth. However, it would be great if there could be some stack traces! Then it will be very easy to spot which line is going wrong.