Support Text-Generation-WebUI

semperai / amica

Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.

https://heyamica.com

MIT License

591 stars 92 forks source link

Support Text-Generation-WebUI #39

Open jobobby04 opened 7 months ago

jobobby04 commented 7 months ago

I mainly use exl2 models since they allow better performance for local models, and the Text-Generation-WebUI is the best option for running them locally.

pyrater commented 6 months ago

It does just not natively. check support docs, works for me in OPENAI API mode. See support documentation here: https://docs.heyamica.com/guides/using-oobabooga