search

mlabonne / llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
https://mlabonne.github.io/blog/
Apache License 2.0
39.12k stars 4.14k forks source link

Mobile deploy of LLM project #26

Open wangzhaode opened 10 months ago

wangzhaode commented 10 months ago

Thanks your project~🚀

Perhaps deploying LLM (Language Learning Models) with a size of 1.8 to 2 billion parameters on mobile or edge devices will become the next hotspot. Here is a mention of work in this area.

https://github.com/wangzhaode/mnn-llm

data-jeong commented 10 months ago

very nice!

mlabonne commented 10 months ago

Cool, I'll add it to the LLM Engineer roadmap. Thans!