-
Very interesting work, thank you for your contribution to the open source community.
1. In the first two papers, verification is done by probability rejection sampling, but I saw that the implement…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
WARNING 08-27 02:59:41 cuda.py:22] You are using a deprecated `pynvml` packag…
-
### Your current environment
```text
PyTorch version: 2.3.0a0+ebedce2
Is debug build: False
CUDA used to build PyTorch: 12.3
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GC…
-
https://github.com/SafeAILab/EAGLE/blob/35854779f60db028ec646d945cacbdebdce490bb/eagle/evaluation/gen_ea_alpha_vicuna.py#L93
It looks like a bug? The calculation of accept_length only considers the…
-
### 🐛 Describe the bug
I am getting this error when running the sample code form pytorch [https://pytorch.org/audio/2.2.0/tutorials/asr_inference_with_cuda_ctc_decoder_tutorial.html?highlight=ctc](…
-
Hello，
I download the model(NCSOFT/Llama-3-OffsetBias-RM-8B) from hugginface。
and then run the code below:
```
pip install -r requirements.txt
```
and then
```
from module import VllmModule
…
-
While building the latest version of the code using
`ant compile`, building fails. Here is the error log which I get
```
Buildfile: /home/hduser/hipi/build.xml
setup:
test_settings:
compile:
[…
-
Repro:
```
sky launch -c vllm2 --image-id docker:vllm/vllm-openai:latest --cloud gcp
```
Fails on setup with:
```
D 06-28 09:46:41 provisioner.py:592] sky.exceptions.CommandError: Command dock…
-
### Your current environment
```text
The output of `python collect_env.py`
```
Collecting environment information...
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorc…
-
```
http://static.electroteque.org.s3.amazonaws.com/download/apple-osmf.zip
Here is the refactored code as a library now with a working example of the m3u8
parsing and multi bitrate setup. I'm not s…