[PyTorch] Multi-LoRA inference

aws-neuron / aws-neuron-sdk

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services

https://aws.amazon.com/machine-learning/neuron/

Other

462 stars 154 forks source link

[PyTorch] Multi-LoRA inference #969

Open eshalakhotia opened 2 months ago