search

AIoT-MLSys-Lab / Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey
https://arxiv.org/abs/2312.03863
1.03k stars 86 forks source link

OpenLLM supports fine-tuning now #12

Closed Jason-cs18 closed 11 months ago

Jason-cs18 commented 11 months ago

Hi team, thanks for your awesome work.

I discovered that OpenLLM has been integrated with HuggingFace PEFT and supports LLM fine-tuning layers. You can see the documentation here: https://github.com/bentoml/OpenLLM#%EF%B8%8F-serving-fine-tuning-layers

SUSTechBruce commented 11 months ago

Thank you for your suggestion, we will cover this latest content in the new version~