-
### System Info
```shell
AWS EC2 instance: trn1.32xlarge
OS: Ubuntu 22.04.4 LTS
Platform:
- Platform: Linux-6.5.0-1023-aws-x86_64-with-glibc2.35
- Python version: 3.10.12
Python packages:
…
cszhz updated
1 month ago
-
### Describe the bug
环境搭建完成，运行第一遍的时候可以跑出结果。后续就一直运行不出来，一般会卡在下面这个状态中。下面状态提醒是否不用管？？
Generating outputs: 0%| …
-
Repair/streaming writes one sstable for each vnode x shard. This can lead to rapid accumulation of small sstable files. To mitigate this, we have an off-strategy compaction at the end of repair/stream…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What would your feature do ?
When you batch generate images and press th…
-
Currently conntroller and servers able to start with s3a path but while creating the segments during ingestion facing following error. The reason is while preparing file names we are prefixing the s3 …
-
### System Info
TGI version: 2.2.0 (but I tested 2.3.0 too)
Machine: 8x H100 (640 GPU RAM)
```
2024-09-25T14:29:44.260160Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unkn…
-
Hi,
I have finetuned Qwen2-VL using Llama-Factory.
I successfully quantized the fine-tuned model as given
```
from transformers import Qwen2VLProcessor
from auto_gptq import BaseQuantizeC…
-
### System Info
Transformers versions: 4.44.2, 4.46.2
PyTorch versions: 2.4.0, 2.5.1
Python version: 3.11.2
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- …
-
### Describe the bug
It seems like two errors pop up
"ERROR: Wheel 'rouge-score' located at C:\users\user\appdata\local\pip\cache\wheels\1e\19\43\8a442dc83660ca25e163e1bd1f89919284ab0d0c1475475148\r…
-
### System Info
- CPU: INTEL RPL
- GPU Name: NVIDIA GTX 3090
- TensorRT-LLM: tensorrt_llm==0.11.0.dev2024060400
- Container Used: Yes and reproduced in Conda as well
- Driver Version: 555.42.02
…