search

microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Apache License 2.0
1.76k stars 163 forks source link

[REQUEST] LLAMA-3 support #475

Open MRYingLEE opened 1 month ago

MRYingLEE commented 1 month ago

LLAMA-3 is one of the most popular models. Please support it.