-
### Your current environment
```text
PyTorch version: 2.2.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC ve…
-
### Motivation
I want to disable logging of prompts into console. It seems like currently there is no option for that?
### Related resources
_No response_
### Additional context
_No response_
-
### Anything you want to discuss about Aphrodite.
I am trying to build a custom version of Aphrodite, however during the build of the Aphrodite engine with docker I need an insane amount of Memory an…
-
If I set `CMD_ADDITIONAL_ARGUMENTS` to `--model turboderp/Mistral-7B-instruct-exl2 --revision 4.0bpw`
Then I get this error:
```
2024-03-13T14:03:42.164428603Z + exec python3 -m aphrodite.endpo…
-
Currently all Aphrodite methods are exposed by an Aphrodite instance, this is simple for the user, however this has resulted in [Aphrodite.java](https://github.com/jboss-set/aphrodite/blob/master/src/…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A …
-
### 🚀 The feature, motivation and pitch
I want use recurrentGemma in aphrodite-engine
ValueError: Model architectures ['RecurrentGemmaForCausalLM'] are not supported for now.
### Alternatives…
-
_**EDIT: I found the problem, it is described in the last comment**_
### Your current environment
```text
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used t…
-
Hi there, I'm trying to use aphrodite to style my react web app, but I didn't figure out how to target classname within StyleSheet.create({}). I'm using this current example, so how can I target these…
-
I was wondering if anyone had made a tool to "convert" style rules from a CSS syntax to a JS object syntax, as accepted by Aphrodite.
This does not need to be fancy, nor smart. Just a small helper …