-
### Your current environment
```text
python env.py
--2024-06-16 20:27:30-- https://raw.githubusercontent.com/PygmalionAI/aphrodite-engine/main/env.py
Resolving raw.githubusercontent.com (raw.gith…
calz1 updated
2 months ago
-
I am using a gguf model on Aphrodite Engine but the issue is that i was to have context length of 8192 ctx but i can got it to load only about 4096 context length, issue is that i'm short on vram...…
-
### Your current environment
```
Collecting environment information...
PyTorch version: 2.3.0
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 2…
-
Lets try to implement it. We need to find a way to support all interfaces, jss, react-jss, styled-jss, aphrodite-jss. Check out stylelint processors api.
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS…
-
### Your current environment
```text
PyTorch version: 2.2.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC vers…
-
### Your current environment
```text
The output of `python env.py`
```
My apologies, everyone, not sure how to provide environment data from a docker container that cannot start. But the hw setu…
elabz updated
3 months ago
-
### Your current environment
```Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.…
-
### Your current environment
aphrodite docker container
Setting 1
GPUs: RTX8000 * 2
model: alpindale/c4ai-command-r-plus-GPTQ
Quantization: gptq
Setting 2
GPUs: A6000 ada * 4
model: Cohe…
-
Aphrodite currently relies on the fact that rendering with React is synchronous in order to build up/pull out the css definitions. The `injectionBuffer` is actually a module level "global" that just g…