Add support for Phi-3 small to FastGen

microsoft / DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

https://www.deepspeed.ai/

Apache License 2.0

34.93k stars 4.06k forks source link

Open adk9 opened 3 months ago