🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
Need to run otter/converting_otter_to_lora.py to convert a normal version OTTER to OTTER-LoRA first. This is for loading previous weights correctly into an OTTER-LoRA, and then start finetune the model.
otter/converting_otter_to_lora.py
to convert a normal version OTTER to OTTER-LoRA first. This is for loading previous weights correctly into an OTTER-LoRA, and then start finetune the model.