-
transformers version: `pip install transformers==4.34.0`
ctransformersversion: `pip install ctransformers==0.2.27`
I encounter the following error
```
File ".venv\lib\site-packages\ctransforme…
-
I'm working on a Mac with an M2 chip. I've installed ctransformers with metal support, and am setting up the model like below. However, when I check what device the model is using, it outputs cpu.
…
-
Hi,
I am trying to use "**TheBloke/WizardCoder-Guanaco-15B-V1.0-GGML**", however, I am getting following error:
```
GGML_ASSERT: /home/runner/work/ctransformers/ctransformers/models/ggml/ggml.c:410…
-
Hi,
When the LLM generate a long answer that exceeded 512 tokens, the program start to show warning message like this:
WARNING:ctransformers:Number of tokens (513) exceeded maximum context length …
-
hi, trying to build this app in local, and used same model llama-2-7b-chat.ggmlv3.q8_0.bin
when run the app UI showing some random message same like you showed but checking in console getting this be…
-
On Ubuntu Focal..
```
Current binding: c_transformers
Current model: None
Menu:
1 - WizardLM-Uncensored-Falcon-40b.reference
2 - Install model
3 - Change binding
4 - Back
Enter your choice:…
-
Hi,
I found your repo by reading the article on https://developer-service.blog/how-to-summarize-articles-with-streamlit-and-langchain-with-mistral-7b-on-cpu/. Great article.
How would you do the…
ijean updated
9 months ago
-
Hi, I tried the following code, but my kernel crashed and restarted, let me know how I should fix this, thanks! :
```
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.f…
-
Hi
I am trying to use ctransformers to load the falcon-40b ggml model and I get the following error
OSError: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /home/ec2-user/anaconda…
-
Hi,
I use debian 11,
python 3.10,
anaconda3
langchain==0.0.240
RAM = 16 Go
swap = 10 Go
SSD = 60 GO
I try to use the simplest program with Ctransfors:
```
from langchain.llms import CTrans…