-
I'm using this example: https://lxt.readthedocs.io/en/latest/quickstart.html#mixtral-8x7b
And I get this error:
```
File "/home/user/app/app.py", line 77, in generate_and_visualize
max_logit…
-
## Description:
Add structured data (JSON-LD format) to the home page to help search engines understand the content and context of the website better. This can include information like the website's …
-
-
### Your current environment
```
I'm attempting to run a multi-node, multi-GPU inference setup using vLLM with pipeline parallelism.
However, I'm encountering an error related to the number of a…
-
Current attempt:
```python
def test_unsloth_vllm(
max_length: int = 8192,
use_4bit: bool = False,
):
print('----> test_unsloth_vllm')
import os
from tra…
-
**Describe the bug**
When I use Transformers to train an embedding model with deepspeed zero2, I got this problem.
**Traceback**
```python
[rank1]: Traceback (most recent call last):
[rank1]: …
-
As previously addressed in e.g. #2417, #2996, #3003, #3208, and #3211, SQLite can't handle multiple concurrent writes. Our SQLite IO Manager has worked around this for the PUDL DB, but we seem to be…
-
Hi,
I'm using version 1.96, and has the problem as following when running the PBMC tutorial:
>>> LL_net.cell_type_specific_TF_RE_binding(GRNdir,adata_RNA,adata_ATAC,genome,celltype,outdir,method…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
### model
model_name_or_path: /Qwen2-VL-7B-Instruct
### method
stage: sft
do_train: true
finetunin…
-
### What happened?
I updated a running llmproxy deployment to a new version. The deployment creates a new container with the new version, verifies its health, and then deletes the old container. In t…