AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.
996
stars
455
forks
source link
[feature-request] text-generation-inference v2.1.0 - Support for multi lora adapters #4028
Open
joaomsimoes opened 3 months ago
This is a great feature to have and to deploy it using Sagemaker endpoint. It is on the road map to update to the latest version of TGI?
The last update was on May 16.