-
### Your current environment
The output of `python collect_env.py`
```text
(myenv) aiscuser@node-0:~/vllm$ python collect_env.py
Collecting environment information...
PyTorch version: 2.4.0+c…
-
./dist_train.sh configs/coco/mask_rcnn_internimage_b_fpn_3x_coco.py 1 --local-rank 0
/home/ahs/anaconda3/envs/llm/lib/python3.9/site-packages/torch/distributed/launch.py:181: FutureWarning: The modul…
-
### Problem Description
runTrace.sh the vLLM benchmark failed
### Operating System
Ubuntu22.04 in the docker image rocm/vllm-dev:20241025-tuned
### CPU
AMD EPYC 9654 96-Core Processor
### GPU
A…
-
pip install vllm (0.6.3) will force a reinstallation of the CPU version torch and replace cuda torch on windows. pip install vllm（0.6.3）将强制重新安装CPU版本的torch并在Windows上替换cuda torch。
> >
> >
> > I don…
-
### Your current environment
The output of `python collect_env.py`
```text
python collect_env.py
Collecting environment information...
2024-09-23 17:57:46.577274: I tensorflow/core/util/po…
-
I am trying to follow the tutorial here - https://www.jetson-ai-lab.com/openvla.html. I get the error message attached.
I am able to run the nanoLLM demo here - https://www.jetson-ai-lab.com/tutor…
-
### Your current environment
```text
Collecting environment information...
WARNING 07-23 19:11:42 _custom_ops.py:14] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm.…
-
## タイトル: マレー語テキストのための職場向け分類器の適応：LLM-Opsフレームワークにおける整合性の向上
## リンク: https://arxiv.org/abs/2407.20729
## 概要:
大規模言語モデル（LLM）が業務ワークフロー（LLM-Ops）にますます統合されるようになるにつれて、言語を問わず、潜在的に安全でない、または不適切なコンテンツを検出する機能など、安…
-
### Your current environment
The output of `python collect_env.py`
WARNING 11-22 07:19:14 cuda.py:22] You are using a deprecated `pynvml` package. Please install `nvidia-ml-py` instead, and make s…
-
## 🚀 Feature
Mixtral 8x7B is a mixture-of-experts LLM that splits the parameters in 8 distinct groups an I would like to do both training and inference with Thunder.
### Work items
- [x] Run `t…