-
Hi @marella
Have you seen the new GGCC model format of ggllm.cpp? This significantly improves the quality of its Falcon model support. There is also improvements to performance.
But it is a ne…
-
**Is your feature request related to a problem? Please describe.**
Usually, I have trouble installing.
**Describe the solution you'd like**
I want to say "pip install deepspeed" and it installed …
-
Hi,
Great job on the repo, I am trying the Collab notebook code like this below which pops up a chat interface:
```
from ctransformers import AutoModelForCausalLM
from IPython.display import d…
-
### Describe the bug
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
op…
-
Hi dear author, ı have trying to do what you are doing right now and it's difficult for me to find learning resources for this kind of stuff finally your library and you are perfect. Thank you for you…
-
Hi
At the moment, all output from gpt4all-j is automatically printed to the screen. This makes the code quite 'noisy' when running from a script.
Ideally this information shouldn't be printed u…
-
## How to reproduce the behaviour
I'm getting an "Unknown function registry: 'llm_backends'" error (see the traceback below) when running the example provided in Matthew Honnibal's blog "Agains…
-
### System Info
### I'm not sure what exactly is causing the issue. Is it langchain, TGI, or streamlit
generate() got multiple keyword arguments for 'stop_sequences' upon running the script along wi…
-
### First, confirm
- [X] I have read the [instruction](https://github.com/Gourieff/sd-webui-reactor/blob/main/README.md) carefully
- [X] I have searched the existing issues
- [X] I have updated the e…
-
add support for llama.ccp for local Ai inferencing