search

PygmalionAI / gradio-ui

Prototype UI for chatting with the Pygmalion models.
GNU Affero General Public License v3.0
225 stars 66 forks source link

Fix SFT models (a.k.a 6B Experimental) when using Kobold #31

Closed 0x000011b closed 1 year ago

0x000011b commented 1 year ago

Henk has fixed the fact that --revision wasn't actually doing anything on Kobold United, so now we're actually pulling the proper SFT versions.

Turns out I only tested SFT with my inference code though - the Kobold client code does not work with SFT models. This PR fixes that.

Fixes https://github.com/PygmalionAI/gradio-ui/issues/28.