iesl / multicls

The code for "Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling"
Other
8 stars 1 forks source link

Are trained multicls models available? #1

Open RoyKashob opened 2 months ago

RoyKashob commented 2 months ago

Hi, Just wondering if the trained models are available somewhere to access. If possible, could you please share it?

ken77921 commented 2 months ago

There are many variations of the model, so it is hard to put all of them online. I put one checkpoint of Ours (K=5, λ = 0.1) and Ours (K=1) in Table 1 here: https://drive.google.com/file/d/1owfAOtwdiMlfr-Iq1zWEt7XFhJNbxhCz/view?usp=sharing .

You should be able to load model using The code here: https://github.com/iesl/multicls/blob/main/submit_formal.sh More specifically, this line https://github.com/iesl/multicls/blob/main/evaluate/main.py#L515

If you need other checkpoints of the models tested in the paper, please send an email to hschang@cs.umass.edu and explain your request.