Open aksub99 opened 4 years ago
The original paper https://arxiv.org/pdf/1810.08678.pdf experiments with bootstrap heads to improve the model's exploration tendency.
The original paper https://arxiv.org/pdf/1810.08678.pdf experiments with bootstrap heads to improve the model's exploration tendency.