Open Takodachi6969 opened 1 year ago
There currently isn't a way to run the model on GPU within the chat UI AFAIK cc @manyoso
Do you have any plan to introduce it? Do you think it's a question of weeks, months or years, just to have an idea?
@niansa As this seems to be the oldest issue for that topic (apart from #463, which drifted a bit towards Python specifics and has also been closed), and this also has the most votes, shouldn't this stay open and the other closed as duplicates?
Let me heavily double this comment
@claell yes, that makes sense. Thank you!
The Chat UI doesn't seem to run on GPU, is there a way to do it? The original method still works, but I don't know how to use it in the chatUI