Add support for PEFT adapters

NVIDIA / nim-deploy

A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.

https://build.nvidia.com/

Apache License 2.0

143 stars 64 forks source link

Closed jmineroff closed 4 weeks ago

jmineroff commented 4 months ago

Allow mounting an existing pvc with LoRA adapters and make the NIM container aware
Implemented all NIM PEFT environment variables currently listed here

supertetelman commented 4 weeks ago

Closing this because we have added this functionality elsewhere as part of the helm chart and NIM Operator.