Selected head list doesn't reset to when model with fewer heads is selected

bhoov / exformer

An Explorable Transformer. A lite version of exBERT

http://exbert.net/

Apache License 2.0

1 stars 1 forks source link

Open bhoov opened 4 years ago

bhoov commented 4 years ago

The list of selected heads does not update when the model is changed from a model with more heads to a model with fewer heads

The maximum number of heads above should just be 6