PygmalionAI / gradio-ui

Prototype UI for chatting with the Pygmalion models.
GNU Affero General Public License v3.0
227 stars 67 forks source link

How to get a Kobold URL? #40

Open tdlio opened 1 year ago

tdlio commented 1 year ago

Cloned repo and running it locally. I launched webUI in a localhost ( using a venv ) but am getting issues:

image image

The issue is a Kobold URL-- how are you guys handling this, and do I need to use Kobold at all? I just want to utilize the Eleuther AI / Pygmalion 6B model at the end of the day.

0x000011b commented 1 year ago

Basically, when the Colab notebook was still live, we'd pull Kobold from its GitHub repo and just start it in the background so the Gradio UI could talk to it.

I see you're on a MBP so it's unlikely you're gonna be able to run the 6B model locally - in that case I recommend just using the official Kobold GPU Colab notebook on their repository, and it'll spit out a link you can use.

tdlio commented 1 year ago

@0x000011b I perhaps DON'T need to run it locally. Let me explain my overall goals and you tell me: I'm trying to launch it into a web app and stylize it with additional functionalities (CSS, etc.) and add a Talking Head (Wav2Lip) .

That shit would look dope on my monitor with my room setup lol. So I guess my first step is I need an environment/editor setup to manage these parts together. What do you recommend?

My computer specs: M2 2022 Macbook Pro, 24GB

K-Jadeja commented 1 year ago

Were you able to launch the web app? I am trying to make something like that for myself too