hf_olmo and the OLMo integration into transformers are not compatible, since both try to register a model from the string "olmo". In particular, hf_olmo fails to import. This change makes hf_olmo not register the model & config when the new transformers version is present. Thus:
On old versions, AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B") will work properly as before (if hf_olmo is imported). AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B-hf") will break.
On new versions, AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B") will break (none of the weights will get loaded). AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B-hf") will work properly. Using OLMoForCausalLM.from_pretrained("allenai/OLMo-1B") with OLMoForCausalLM from hf_olmo will work just like in old versions.
hf_olmoand the OLMo integration intotransformersare not compatible, since both try to register a model from the string "olmo". In particular,hf_olmofails to import. This change makeshf_olmonot register the model & config when the new transformers version is present. Thus:AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B")will work properly as before (ifhf_olmois imported).AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B-hf")will break.AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B")will break (none of the weights will get loaded).AutoModelForCausalLM.from_pretrained("allenai/OLMo-1B-hf")will work properly. UsingOLMoForCausalLM.from_pretrained("allenai/OLMo-1B")withOLMoForCausalLMfromhf_olmowill work just like in old versions.