Closed CheungZeeCn closed 2 years ago
Hi,
After training you should use the converter to convert the checkpoints to huggingface-style. Please read the simcse_to_huggingface.py
part of readme.
Hi,
After training you should use the converter to convert the checkpoints to huggingface-style. Please read the
simcse_to_huggingface.py
part of readme.
Thanks~
my unsup model is trained with pooler type 'cls', I want to use it for getting sentence embs;
While getting into the code, I am wondering which way I should use.
Should I loading the mlp weights or not ?
model.py : about line 232
but in tool.SIMCSE
since the model is init from
the pooler weights are not loaded the mlp weights are not loaded neither. we got:
So I cannot get the same embs output in this way.