-
Hi,
I'm having trouble with Mistral because the model is not loading on GPU but it is only running on CPU.
That's the code:
```
from ctransformers import AutoModelForCausalLM, Config, hub
ll…
-
- [ ] [migtissera/Synthia-70B-v1.2b · Hugging Face](https://huggingface.co/migtissera/Synthia-70B-v1.2b)
# migtissera/Synthia-70B-v1.2b · Hugging Face
**DESCRIPTION:**
Change from 1.2 -> 1.2b: Mo…
-
Model on https://github.com/marella/chatdocs/blob/main/setup.py
-
### Issue with current documentation:
The [documentation](https://python.langchain.com/docs/use_cases/summarization) describes the different options for summarizing a text, for longer texts the 'map_…
-
I'm trying to add a model that already exists on my computer.
To do this, I enter the path to my model in the “Create a reference from local file path:” field. I entered D:\Prgrms\LM Studio\models\g…
-
Hello,
Is this code written to run only on CPU. I dont think GPU is being used and the response time is very slow.
If it is written to be run on CPU for now then can you suggest the changes (dev…
-
### Feature request
Right now, it seems like the only implementation for ONNX exports of HuggingFace models is to use them in Python inferencing. It would be great we could export Hugging Face Transf…
vymao updated
7 months ago
-
-
OSError: /lib/x86_64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found
-
I'm trying to load TheBloke/Llama-2-7b-Chat-GPTQ from the local directory with the sample code provided here:
```
from ctransformers import AutoModelForCausalLM
llm = AutoModelForCausalLM.from_p…