Hi, it seems that unsloth currently does not support loading base model trained by OLMo. Is it possible to write custom script to load the model into unsloth? The model architecture is shown below, and it is also using the "pre-layernorm" transformer architecture.
Hi, it seems that unsloth currently does not support loading base model trained by OLMo. Is it possible to write custom script to load the model into unsloth? The model architecture is shown below, and it is also using the "pre-layernorm" transformer architecture.