predibase / lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
https://loraexchange.ai
Apache License 2.0
1.86k stars 126 forks source link

Retrieve all lora models from Huggingface hub by base model setting. #463

Open svjack opened 1 month ago

svjack commented 1 month ago

Feature request

Retrieve all lora models from Huggingface hub by base model setting. such as collect all lora based on meta-llama/Meta-Llama-3-8B

Motivation

If I want to take a look at all lora models on the same base model from Huggingface Hub, It will be convenient if I can automatically collect all available lora weights based on some model.

Your contribution

It will not too difficult, that only parse the config file of every lora model will will achieve this purpose.

tgaddair commented 1 month ago

Hey @svjack, to make sure I understand the request: you're looking for something like a /list endpoint that shows all compatible adapters for the loaded base model, is that correct?

svjack commented 1 month ago

Hey @svjack, to make sure I understand the request: you're looking for something like a /list endpoint that shows all compatible adapters for the loaded base model, is that correct?

sure