search

qnguyen3 / chat-with-mlx

An all-in-one LLMs Chat UI for Apple Silicon Mac using MLX Framework.
https://twitter.com/stablequan
MIT License
1.45k stars 131 forks source link

Add a new small model #52

Open Lynncc6 opened 5 months ago

Lynncc6 commented 5 months ago

Our team released a fantastic end-side model called MiniCPM-2B recently.

Experimental Result：MiniCPM-2B outperforms Llama2-70B-Chat, Mistral-7B, etc. on MTBench.Runs ultra-fast on Apple Silicon.

Looking forward to be merged into your framework.

Tech Report: https://shengdinghu.notion.site/MiniCPM-Unveiling-the-Potential-of-End-side-Large-Language-Models-d4d3a8c426424654a4e80e42a711cb20

Github: https://github.com/OpenBMB/MiniCPM

Lynncc6 commented 5 months ago

https://huggingface.co/runfuture/MiniCPM-2B-dpo-fp16-gguf/tree/main