Image processor in mimic dataset

Luodian / Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

https://otter-ntu.github.io/

MIT License

3.54k stars 242 forks source link

Image processor in mimic dataset #281

Open baibizhe opened 10 months ago

baibizhe commented 10 months ago

After checking the code. I found even the image_processor has been passed to https://github.com/Luodian/Otter/blob/283a74c268bc01d656ee4b37f11ff8db8160ea3e/pipeline/train/data.py#L645 . However , it haven't been used. My question is , if I choose mimidataset, where does the image_processor has been used?

Best regards