Closed pankajroark closed 3 months ago
Allows loading Lora dynamically as part of request. Lora are cached and reused. On cache eviction Lora are loading again as needed. Currently Lora is only accepted via a HuggingFace repo path.
Allows loading Lora dynamically as part of request. Lora are cached and reused. On cache eviction Lora are loading again as needed. Currently Lora is only accepted via a HuggingFace repo path.