-
### Your current environment
```
Docker container, can't check
```
### š Describe the bug
When I set `NUM_GPUS` to 8 (due to having a server with 8 GPU's) I get the following error (sorry but tā¦
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OSā¦
-
### Your current environment
```text
PyTorch version: 2.3.0
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC version: (ā¦
-
Everything seems to work fine via the embedded klite interface, but when I pointed horde at it, it started throwing these:
It seems to kinda sorta maybe still serve horde requests?
```
INFO 01-ā¦
ycros updated
7 months ago
-
### The model to consider.
https://huggingface.co/serpdotai/sparsetral-16x7B-v2-SPIN_iter1
https://huggingface.co/LoneStriker/sparsetral-16x7B-v2-8.0bpw-h8-exl2/tree/main
https://huggingface.co/hā¦
-
### š The feature, motivation and pitch
The CohereForAI/aya-23-8B model is a new model and has very competitive performance.
It currently is not supported because the model is of type "CohereForCausā¦
-
**Hey, I've noticed that whenever I try to use GPTQ quantized models, it doesn't work. I've noticed it sees it as AWQ and not GPTQ, I don't know why that is because it worked fine yesterday. I tried tā¦
-
Hi,
The last release was v2.4.0 in Aug 2019, and there is 0 commits since then. The commits were far in between, only 27 commits since v. 2.2.3 in Aug 2018.
I see that the main contributors areā¦
-
Just wonder is it possible to use A with B?
My existing project using Bootstrap and looks like:
``
But Aphrodite asks for something like:
``
Question:
How can I merge these 2 approacheā¦
-
Hey guys, I'm using Next.js to server side render my app. I have some components that render solely on the client, and some that render on the server.
I tried utilizing Aphrodite's StyleSheet.rehydā¦