microsoft / Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open sourced AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.
MIT License
2.5k stars 259 forks source link

How to fix the seed during Phi3.5V training. #226

Open qwedaq opened 1 week ago

qwedaq commented 1 week ago

This issue is for a: (mark with an x)

- [x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Thank you for your code. I would like to know how to fix the seed during training of Phi3.5V model? I have used set_seed from transformers and also fixed a seed value in training args of Trainer but none of them actually gave me the same values for two runs.