[Eval/Model] update few-shot evaluations on public datasets.

Luodian / Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

https://otter-ntu.github.io/

MIT License

3.56k stars 241 forks source link

[Eval/Model] update few-shot evaluations on public datasets. #238

Closed Luodian closed 1 year ago

Luodian commented 1 year ago

also update with ijson to save tons of CPU mem.