AttributeError: 'SimPOConfig' object has no attribute 'ref_model_init_kwargs'. Did you mean 'model_init_kwargs'?

princeton-nlp / SimPO

SimPO: Simple Preference Optimization with a Reference-Free Reward

MIT License

629 stars 36 forks source link

AttributeError: 'SimPOConfig' object has no attribute 'ref_model_init_kwargs'. Did you mean 'model_init_kwargs'? #34

Open Saumajit opened 2 months ago

Saumajit commented 2 months ago

I am following the run_simpo.py and running it in my system on a custom dataset (prepared in a similar format). I am getting the above mentioned error. I also tried to initialize ref_model_init_kwargs = model_init_kwargs and pass on to the trainer. However the error still persists. Please let me know what can be the possible fix to this solution?

yumeng5 commented 2 months ago

Hi,

I'm not sure what caused the error you encountered as we haven't run into similar issues. We just updated the trainer scripts, and hopefully, the issues caused by using different package versions can be eliminated. Could you try again with the latest codebase?

Best, Yu

Saumajit commented 2 months ago

Hi, I was using phi3/phi2 with data prepared accordingly. I got this error and thus I couldn't proceed. Any idea if that error is due to choosing the aforesaid model or for something else?