search

OpenNMT / OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch
https://opennmt.net/
MIT License
6.73k stars 2.25k forks source link

update to skipinit weights with bnb #2524

Closed vince62s closed 10 months ago

vince62s commented 10 months ago

prior to bnb < 0.40.0 the device could not be passed to the original Linear4bit() preventing from using skip_init() Now it's implemented, so removing the copy-paste / modified version of Linear4bit (and 8bit).