-
### Checks
- [X] This template is only for question, not feature requests or bug reports.
- [X] I have thoroughly reviewed the project documentation and read the related paper(s).
- [X] I have search…
-
I got Error Code 8: Internal Error (shape calculation overflow) when executing the benchmark using the follow command:
```bash
mpirun -n 8 python benchmark.py -m llama_70b --mode plugin --batch_size…
-
Hi. Are Extensions still supported in the current jsonschema boon branch? I am trying to migrate to the newest version and noticed that functions like ```func (c *Compiler) RegisterExtension(name stri…
-
Making a ticket for the problem mentioned elsewhere about practicing "mas" over and over.
-
我看到Readme里这张图里好像去掉了帧的头部
![image](https://github.com/user-attachments/assets/f6cc1157-f3fa-4719-ae1e-1b827435f0ba)
但是我自己预处理得到的数据没有去掉头部
![image](https://github.com/user-attachments/assets/e7dbd0d8-fe…
-
while running get_vocab.py on an experiment dataset of the first 40 lines in data/chembl/all.txt , i get the following error message :
I've tried going to the respective line in chem_utils.py an…
-
Consider implementing the Liger Kernels which has shown to yield large memory savings.
- RoPE: 3X speedup with ~3X peak memory reduction.
- SwiGLU: 1.5X peak memory reduction
- Cross Entropy: >4X…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### How would you like to use vllm
When I use a different different LLM, I have to set --max-logprobs to it's voca…
-
How can I launch GigaAM_RNNT using ONNX?
sherpa-onnx crashes colab(
Please, help me with this
-
Metadata records are tagged using keywords, preferably these keywords originate from controlled vocabs (thesauri). SWR uses these keyword+vocab combi's (subjects) to filter and aggregate
First we n…