🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
The following code to load "luodian/openflamingo-9b-hf" for ConditionalGeneration:
from flamingo import FlamingoForConditionalGeneration
model = FlamingoForConditionalGeneration.from_pretrained("luodian/openflamingo-9b-hf")
Resulted in:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.9/dist-packages/transformers/modeling_utils.py", line 2700, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
File "/Otter/flamingo/modeling_flamingo.py", line 713, in __init__
if config.text_config.architectures[0] == "MPTForCausalLM":
TypeError: 'NoneType' object is not subscriptable
Based on the FlamingoModel Class, I noticed the following comment line, when I uncomment it, the model loads correctly.
The following code to load "luodian/openflamingo-9b-hf" for ConditionalGeneration:
Resulted in:
Based on the FlamingoModel Class, I noticed the following comment line, when I uncomment it, the model loads correctly.