Update to latest version of transformers

Aleph-Alpha / magma

MAGMA - a GPT-style multimodal model that can understand any combination of images and language. NOTE: The freely available model from this repo is only a demo. For the latest multimodal and multilingual models from Aleph Alpha check out our website https://app.aleph-alpha.com

MIT License

469 stars 55 forks source link

Update to latest version of transformers #5

Closed sdtblck closed 2 years ago

sdtblck commented 2 years ago

Will require changes to GPTJ

CoEich commented 2 years ago

TODO:

Compare gpt-j model outputs of of the different transformer versions
Ensure backwards compatibility, i.e being able to load old checkpoints