search

huggingface / text-generation-inference

Large Language Model Text Generation Inference
http://hf.co/docs/text-generation-inference
Apache License 2.0
8.32k stars 941 forks source link

Low-Rank Adaptation of Large Language Models #1973

Closed mhou7712 closed 18 hours ago

mhou7712 commented 1 month ago

Feature request

Low-Rank Adaptation of Large Language Models

Motivation

Please review the link: https://docs.vllm.ai/en/stable/models/lora.html

It will be great that TGI can provide the LoRA feature.

Your contribution

N/A

ming-ddtechcg commented 1 month ago

Another LoRA example can be found at https://github.com/predibase/lorax.

mhou7712 commented 3 weeks ago

From another thread for LoRA: https://github.com/huggingface/text-generation-inference/pull/935

mhou7712 commented 4 days ago

refer to: https://github.com/huggingface/text-generation-inference/pull/2010

mhou7712 commented 18 hours ago

closed for now.