Closed AlexKalinowski-Zoetis closed 1 year ago
Will future models be released with MLM heads?
Hi Alex, all the Galactica models were trained with a Causal LM objective. We don't plan training MLM heads for now.
Will future models be released with MLM heads?