search

bigscience-workshop / multilingual-modeling

BLOOM+1: Adapting BLOOM model to support a new unseen language
https://arxiv.org/abs/2212.09535
Apache License 2.0
69 stars 15 forks source link

Implement "Adaptable Adapters" #34

Open haileyschoelkopf opened 2 years ago

haileyschoelkopf commented 2 years ago

Authors told us the code will be released by July 10. We might want to implement it ourselves though in adapter-transformers if we have time or their code is difficult to use

yongzx commented 2 years ago

Using rational activations: library