search

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
776 stars 61 forks source link

Support for OPT #30

Closed mrzjy closed 2 years ago

mrzjy commented 2 years ago

Hi,

Would it be possible to support new OPT models (a suite of GPT-like models)?

Here's the official doc: https://huggingface.co/docs/transformers/model_doc/opt

Thanks for your great work!

hyunwoongko commented 2 years ago

Could you update the library using pip install --upgrade?