[Feat/Model] add get_decoder for mpt-1B

Luodian / Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

https://otter-ntu.github.io/

MIT License

3.56k stars 241 forks source link

[Feat/Model] add get_decoder for mpt-1B #211

Closed ZhangYuanhan-AI closed 1 year ago

ZhangYuanhan-AI commented 1 year ago

add get_decoder fro mpt-1B

Luodian commented 1 year ago

Have tested for DDP training, but still got errors in FSDP.