search

PygmalionAI / gradio-ui

Prototype UI for chatting with the Pygmalion models.
GNU Affero General Public License v3.0
227 stars 67 forks source link

Pls clarify nature of colab ban #39

Open samrahimi opened 1 year ago

samrahimi commented 1 year ago

2 questions (brilliant work btw!)

  1. is there an automated process preventing the use of this model on colab? if so, what's being blocked... i saw your notes from an earlier commit.
  2. WHY are they blocking it? it this model ONLY good for nsfw? or is that just one of its uses?
  3. Can this run on CPU? What about on an iPad pro, its not an M series but its a decent one just a few years old
0x000011b commented 1 year ago

Hello! Basically:

  1. As for what's being blocked: Google detects any instances of /PygmalionAI/ inside the notebook's cells and automatically warns that your account may be banned if you decide to run the code, so we've removed the easy Colab notebook for now to prevent anyone from being unfairly banned. There are obviously workarounds for this, but we'd rather respect Google's wishes. It's their service after all.
  2. Your guess is as good as mine. The ban was done without any explanation from Google's end, and when we reached out for clarification the response we got was basically "sorry, we don't offer any sort of support for Colab". The model can do SFW just fine, and there's plenty of other NSFW Colabs out there (e.g. for Stable Diffusion), so I think it's pretty unlikely that this is the reason.
  3. It should. ggml allows running quantized LMs on CPU at reasonable speeds (see: llama.cpp), it'd just be a matter of implementing the relevant backing model architecture (GPT-J for 6B, NeoX for 1.3B/2.7B, OPT for 350M as of now) and having some sort of UI to interact with the model. This is outside the scope of the project though, so unfortunately I don't have any pointers for that.