-
**Describe the bug**
It's frustrating to run i.e. `ilab -v data generate` only to get:
```
...
DEBUG 2024-09-12 13:23:22,053 instructlab.model.backends.vllm:205: vLLM serving command is: ['/opt/…
-
**Describe the bug**
```shell
Jan 04 22:30:14.302 [INFO] test-run-1112b accumulated 10 samples for epoch #0 from 2 peers. ETA 0.00 sec (refresh in 0.50 sec)
Jan 04 22:30:14.476 [INFO] Beginning opt…
-
执行：
import torch
from modelscope import AutoModel, AutoTokenizer
model_id = 'ZhipuAI/codegeex2-6b'
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoMode…
-
### System Info
- DGX-A100
- Triton Image : v0.7.2
### Who can help?
@kaiyux
_No response_
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Ta…
-
Ordered by priority:
- [x] int32_t
- [x] int64_t
- [x] bool
- [ ] half precision / bfloat16
- [ ] Categorical (a.k.a enum)
- [x] int16_t
- [x] int8_t
stoni updated
2 years ago
-
hi.
I am a student who wants to use your "TileSPGEMM"code.
But unfortunately I am facing this error.
nvcc -O3 -w -arch=compute_61 -code=sm_86 -gencode=arch=compute_61,code=sm_86 -Xcompiler -f…
-
### 🚀 The feature, motivation and pitch
Hi Pytorch maintainers,
I am currently engaged in training multiple large language models (LLMs) sequentially on a single GPU machine, utilizing FullShard…
-
### Description:
Currently, the [test](https://github.com/unifyai/ivy/blob/main/ivy_tests/test_ivy/test_frontends/test_tensorflow/test_math.py#L1015) for [tensorflow_frontend.floormod](https://github…
-
### Checklist
- [ ] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
ilLo9 updated
2 weeks ago
-
## Motivation
Expand Pytroch C10D backend to allow dynamic loading non-built-in communication libraries, as a preparation step to integrate Intel CCL (aka MLSL) to Pytorch as another c10d backend fo…