PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine
https://pygmalion.chat
GNU Affero General Public License v3.0
721 stars 85 forks source link

[Usage]: Lora Adapter Parameter while inferencing #464

Closed alokgupta1996 closed 1 month ago

alokgupta1996 commented 1 month ago

Your current environment

I see the option to load the lora adapters in the fast api ui. Is the number of adapters that can be loaded is limited to one If not where to pass the name of the loaded adapters so that it can be used while inferencing.

How would you like to use Aphrodite?

No response

alokgupta1996 commented 1 month ago

Solved Thanks