-
https://colab.research.google.com/drive/1c6v2UUTcvrRtJBCxLk67KCWS_pd_2hCA
![image](https://github.com/marella/ctransformers/assets/41443157/6eaab3c1-d4cf-426c-a810-0d4ce08e171d)
segmentation fau…
-
Hello! Kudos for your nice work on the open-source community of LLM's. I'm learning a lot for your findings.
I've tried to run the latest commit on a GCP VM with 32GB of ram.
And I've found thi…
-
### System Info
Python 3.10.12
gpt4all==1.0.3
Ubuntu 20.04.6 LTS
### Information
- [X] The official example notebooks/scripts
- [ ] My own modified scripts
### Related Components
-…
-
Hi, is there any way to increase the lenght of the responses, the answers just cut off in the middle and there is no way to continue the prompt
-
### 提交前必须检查以下项目
- [X] 请确保使用的是仓库最新代码(git pull),一些问题已被解决和修复。
- [X] 我已阅读[项目文档](https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/wiki)和[FAQ章节](https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/wiki/常见问题)并且已…
-
@marella thanks, very usefull project
I use llama ggml model
With latest `llama.cpp` it says `Привіт`, but with ctransformers only `ривіт`
It is related to all words, not only first in a responce.…
-
### Describe the bug
### Brief Description of the Bug
I encountered an failure while attempting to boot up the webui server on a clean install of WSL using one-click installer.
I managed to resol…
-
### Describe the bug
When building the docker with BUILD_EXTENSIONS set to openai and coqui_tts, build fails due to a dependency conflict.
### Is there an existing issue for this?
- [X] I have sear…
-
For some reason, I'm not able to get streaming response in chainlit UI although I do get streaming output normally in console. @willydouhard
This is my code:
# Imports
from langchain import Hu…
-
I have a real bug this time.
```
ggml_new_tensor_impl: not enough space in the scratch memory pool (needed 575702016, available 268435456)
Segmentation fault
```
This affects ggml implementat…