Implement “Composable Sparse Fine-tuning for Cross-Lingual Transfer” - Githubissues

bigscience-workshop / multilingual-modeling

BLOOM+1: Adapting BLOOM model to support a new unseen language

https://arxiv.org/abs/2212.09535

Apache License 2.0

69 stars 15 forks source link

Implement “Composable Sparse Fine-tuning for Cross-Lingual Transfer” #23

Open haileyschoelkopf opened 2 years ago

haileyschoelkopf commented 2 years ago

Paper: https://aclanthology.org/2022.acl-long.125/

Implementation from paper here: https://github.com/cambridgeltl/composable-sft

I’ll work on this starting tomorrow.