mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
18.82k stars 1.53k forks source link

[Feature Request] phi-3 small realeased -> performs two times ebtter then Phi-3 mini #2420

Open sebastienbo opened 4 months ago

sebastienbo commented 4 months ago

🚀 Feature

[Feature Request] phi-3 small released -> performs two times better then Phi-3 mini https://huggingface.co/microsoft/Phi-3-small-128k-instruct

Motivation

Phi-3 small just came out and it is still small enough to fit any snapdragon cpu It scores twice as much as the older phi-3 mini

ps: The phi-3 medium also came out

image

Alternatives

Additional context

sebastienbo commented 4 months ago

It's a cool model