Closed fiveisgreen closed 3 months ago
It would be very nice to be able to use this with LM Studio, and other popular AI server platforms.
Hi @fiveisgreen ,
I think it uses llama.cpp under the hood. This is already supported, you just need to modify the init function.
init
Best regards, David
It would be very nice to be able to use this with LM Studio, and other popular AI server platforms.