updated madx_run_clm,py

bigscience-workshop / multilingual-modeling

BLOOM+1: Adapting BLOOM model to support a new unseen language

https://arxiv.org/abs/2212.09535

Apache License 2.0

69 stars 15 forks source link

Closed vnikouliNLE closed 2 years ago

vnikouliNLE commented 2 years ago

backcompatibility with previous BS model
added option "--layers" to specify where you want to add adapters
adapter-config now accepts "prefix_tuning"
changed overlap-replace implementation. I am not sure that the embedding was trained properly in the previous version

yongzx commented 2 years ago

Thanks @vnikouliNLE! I'm reviewing it today.