unslothai / unsloth

Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory
https://unsloth.ai
Apache License 2.0
18.57k stars 1.3k forks source link

Fix DPO, ORPO #1177

Closed danielhanchen closed 1 month ago

urisolve commented 1 month ago

Something went wrong in todays update. Now, in the import I got the error: File /usr/local/lib/python3.11/dist-packages/unsloth/kernels/cross_entropy_loss.py:449 446 function = "\n".join(function) 447 function = f"class Unsloth_LlamaForCausalLM(LlamaForCausalLM):\n"\ 448 f" {function}\n" --> 449 exec(function, globals()) 450 del function, replacement, inspect, re 453 def patch_llama_for_causal_lm():

File :1

File :16, in Unsloth_LlamaForCausalLM()

NameError: name 'Unpack' is not defined

danielhanchen commented 1 month ago

@urisolve Fixed - I think I just mentioned it in the other issue you were interacting with