search

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
776 stars 61 forks source link

Can you please add support for gpt_neox #34

Open tahercoolguy opened 2 years ago

tahercoolguy commented 2 years ago

Describe a requested feature

Can you please add support for gpt_neox

Its official documentation is here https://huggingface.co/docs/transformers/model_doc/gpt_neox

hyunwoongko commented 2 years ago

Can you make a policy of the model?

hyunwoongko commented 2 years ago

You can refer to https://github.com/tunib-ai/parallelformers/blob/main/parallelformers/policies