search

ParisNeo / lollms-webui

Lord of Large Language Models Web User Interface
https://parisneo.github.io/lollms-webui/
Apache License 2.0
4.2k stars 528 forks source link

Add support for other backend #103

Open ParisNeo opened 1 year ago

ParisNeo commented 1 year ago

Expected Behavior

We should be able to select different backends. Need at least to support : 1- llamacpp 2- gpt-j 3- hugging face transformers models

Current Behavior

Only llamacpp is supported

ParisNeo commented 1 year ago

Now gpt-j backend is supported with a simplified mode (no word by word output)

andzejsp commented 1 year ago

this is completed