hpcaitech / EnergonAI

Large-scale model inference.
Apache License 2.0
631 stars 90 forks source link

Support OPT-IML model #184

Closed ericxsun closed 1 year ago

ericxsun commented 1 year ago

Meta has released the OPT-IML model (OPT + Instruction Meta-Learning). Could you help me load its checkpoint?

binmakeswell commented 1 year ago

Due to limited manpower, it is unrealistic for us to directly provide 1-to-1 example support for all models, but it should be similar to OPT. Thanks. https://github.com/hpcaitech/EnergonAI/tree/main/examples/opt