Open ParisNeo opened 1 year ago
We should be able to select different backends. Need at least to support : 1- llamacpp 2- gpt-j 3- hugging face transformers models
Only llamacpp is supported
Now gpt-j backend is supported with a simplified mode (no word by word output)
this is completed
Expected Behavior
We should be able to select different backends. Need at least to support : 1- llamacpp 2- gpt-j 3- hugging face transformers models
Current Behavior
Only llamacpp is supported