-
### Describe the bug
I have built a Docker image myself and deployed xinference on k8s. The homepage can be accessed normally. However, loading the model failed, and the error message is 'not found'.…
-
Hi, just wondering with the new open sources coming out like llama2 or any other at that level i hugginface why are we still using API from openai???... If i can operate at the same level as GT4 using…
-
Hi,
We have an old model trained with ktrain (0.21.4). We have the `.h5` file and the `.preproc` file. However, we have lost a reference to the data that we used to train it(perhaps even the training…
-
I'm getting errors with starcoder models when I try to include any non-trivial amount of tokens. I'm getting this with both my raw model (direct .bin) and quantized model regardless of version (pre Q4…
-
**What version of protobuf and what language are you using?**
Version: protobuf-4.23.1, protobuf-4.23.1 no binary, protobuf-3.2.0, protobuf-4.21.9, protobuf-4.21.11
**What operating system (Linux,…
-
### Describe the bug
Load this model. No matter what settings I set (such as gpu layers), model runs entirely on cpu
https://huggingface.co/dhairya0907/meta-llama-2-7b-chat-hf-gguf-v1
I did tr…
-
### Describe the bug
installation breaks because fastapi and elevenlabs require incompatible versions of pydantic.
### Is there an existing issue for this?
- [X] I have searched the existing issues…
-
I get the following error when I run `docker compose up --build` on macos.
I've already tried installed build-essentials.
```
langflow % docker compose up --build
[+] Building 51.1s (27/27) …
3eif updated
10 months ago
-
### Describe the bug
Can't load GPTQ model with ExLlamav2_HF and ExLlamav2. I have tried these two models:
- TheBloke_upstage-llama-30b-instruct-2048-GPTQ_gptq-4bit-128g-actorder_True
- TheBloke_Op…
-
Quite similar to #1127 , although this issue is triggered in a different context by a different rule, so probably worth a different issue
**Describe the bug**
`cabal_package` generates `.so` fil…