-
Maybe something like in Aphrodite? https://github.com/Khan/aphrodite#server-side-rendering
-
### Your current environment
```text
Collecting environment information... [0/668]
PyTorch version: 2.2…
-
So you are not measuring equally everything.
-
### Your current environment
```text
PyTorch version: 2.2.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC vers…
-
### Feature request
if LoRAX is based on punica kernels will it be able to support LoRA Adapters for Mistral NeMO 12B? which has a vocab size > 130k.
Currently Vllm for example doesn't support voca…
-
After linking two components with _Aphrodite_ instance themes called using `css([style1, style2])` are removed in `style[data-aphrodite]` tag.
-
### Your current environment
```text
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC vers…
-
Is it possible to have something similar to aphrodite global extention:
https://github.com/Khan/aphrodite#creating-extensions
-
Hi!
First of all thanks for making this interface!
Is it possible to export the following test-utility function from aphrodite:
StyleSheetTestUtils
This would remove the need to add the comple…
-
This feature would allow users who are hosting their own LLMs using OpenAI API compatible services such as vllm, aphrodite-engine, and others to use them with the memgraph-lab AI chat.
Broadly, use…