search

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
776 stars 61 forks source link

Integration Note with Huggingface Transformers & Microsoft DeepSpeed #11

Closed hyunwoongko closed 2 years ago

hyunwoongko commented 3 years ago

I started recording my work here. please note. @stas00 @RezaYazdaniAminabadi

hyunwoongko commented 2 years ago

https://github.com/huggingface/transformers/pull/13726 start to merge into huggingface transformers