search

microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Apache License 2.0
1.91k stars 175 forks source link

[REQUEST] LLAMA-3 support #475

Open MRYingLEE opened 6 months ago

MRYingLEE commented 6 months ago

LLAMA-3 is one of the most popular models. Please support it.