Add the possibility to freeze the decoder. Note freezing the decoder will freeze the encoder embed_tokens layer that is by default tied to proj_out layers (not a layer of the decoder). This way, proj_out also gets frozen, it is thus necessary to unfreeze it.
other minor changes:
use set_seedfrom Accelerate that will also set the seed for numpy
Add the possibility to freeze the decoder. Note freezing the decoder will freeze the encoder
embed_tokenslayer that is by default tied toproj_outlayers (not a layer of the decoder). This way,proj_outalso gets frozen, it is thus necessary to unfreeze it.other minor changes:
set_seedfrom Accelerate that will also set the seed for numpy