-
@hippalectryon-0 introduced HF text embeddings with #45.
May you - if it fits you well - elaborate how [this](https://github.com/marella/ctransformers#langchain) performs?
Edit: missing embeddi…
-
hey any chance the team can work to provide ctransformers / GGML support? also key description options would be clutch, thanks
-
## Expected Behavior
Selected model after downloading it.
## Current Behavior
It looks like you we couldn't load the model.
Here is the error message:
Could not find module 'D:\lollms-webui\ins…
-
**env:**
transformers ==4.35.2
ctransformers==0.2.27+cu121
```
from ctransformers import AutoModelForCausalLM, AutoTokenizer
model_name = "/home/me/project/search_engine/text-generation-web…
-
I am trying to run this project on a Macbook pro m1 and am getting the following stacktrace.
```
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/chainlit/utils…
-
I am trying to dockerize a LLM (Mistral) on my local laptop using Ctransformers. For some reason I am noticing a weird error below. However, the same is not happening If I run the model locally in my …
-
### Model Series
Qwen2.5
### What are the models used?
Qwen2.5-32B-Instruct
### What is the scenario where the problem happened?
Xinference
### Is this a known issue?
- [X] I have followed [the…
-
Does ctransformers support ollama models?
How do I specify the model in this code below?
llm = CTransformers(model="***where is the model file for a ollama model?",
model_…
-
Is there any chance of a future integration with CTransformers or something similar to allow for guided generation using quantized models on CPU? If I were to try and hack away at this, what would be …
-
Tracker to add support to ctransformers https://github.com/marella/ctransformers
https://github.com/jllllll/ctransformers-cuBLAS-wheels