-
I am trying to dockerize a LLM (Mistral) on my local laptop using Ctransformers. For some reason I am noticing a weird error below. However, the same is not happening If I run the model locally in my …
-
### Description
@vince-westmonroe has been playing around with locally hosted LLMs and LangChain. It turns out that LangChain has internal support for the CTransformers package that will download m…
-
**env:**
transformers ==4.35.2
ctransformers==0.2.27+cu121
```
from ctransformers import AutoModelForCausalLM, AutoTokenizer
model_name = "/home/me/project/search_engine/text-generation-web…
-
hey any chance the team can work to provide ctransformers / GGML support? also key description options would be clutch, thanks
-
## Expected Behavior
Selected model after downloading it.
## Current Behavior
It looks like you we couldn't load the model.
Here is the error message:
Could not find module 'D:\lollms-webui\ins…
-
@hippalectryon-0 introduced HF text embeddings with #45.
May you - if it fits you well - elaborate how [this](https://github.com/marella/ctransformers#langchain) performs?
Edit: missing embeddi…
-
### Issue you'd like to raise.
I have installed langchain and ctransformer using -
```
pip install langchain
pip install ctransformers[cuda]
```
I am trying following piece of code -
```
…
-
I am trying to run this project on a Macbook pro m1 and am getting the following stacktrace.
```
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/chainlit/utils…
-
Just curious if this and ctransformers are still being supported? There has been no activity and no updates in close to 6 Months that I've seen.
-
Does ctransformers support ollama models?
How do I specify the model in this code below?
llm = CTransformers(model="***where is the model file for a ollama model?",
model_…