-
frame #6: c10d::ProcessGroupNCCL::ncclCommWatchdog() + 0x10c (0x7f3f32cae6fc in /opt/conda/envs/vrm/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #7: + 0xd3e95 (0x7f40271b5e95 in /o…
-
Hi, thank you for your great work!
I was trying to use your toolkit to evaluate my trained llava-llama3. My llama3 was designed to stop generation after the `` token. In the original LLaVA repo, I …
-
Error when using file to generate UI - ERROR (openui):
ERROR (openui): Server Error: Object of type bytes is not JSON serializable
Traceback (most recent call last):
File "E:\Desktop\AliTech …
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
When running the w4a16…
-
```
python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port=30020 --host="0.0.0.0" --tp-size=1 --random-seed=1234 --context-l…
-
### Checklist
- [x] 1. I have searched related issues but cannot get the expected help.
- [x] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…
-
```bash
[2024-05-14T03:15:53Z ERROR winit::platform_impl::platform] X11 error: XError {
description: "BadAlloc (insufficient resources for operation)",
error_code: 11,
…
-
### What is the issue?
On Windows with version 0.1.33 assembling two models creates a path error.
Version 0.1.32 works correctly.
You can manifest the bug by assembling this model: (there is also …
-
Very thank for yout great job 🙏
I want to replace **Vicuna-7B** with **meta-llama/Meta-Llama-3-8B-Instruct**, I heard that llama3 performs better, so there may be some gains after replacement.
…