-
### Description
I first encountered this issue in a larger code I was trying to run. Then, I was able to create a bare minimum version as follows. I think the `jnp.linalg.cholesky` is making it slowe…
-
### System Info
```Shell
accelerate Version: 0.30.1
torch Version: 2.3.0
transformers Version: 4.41.2
GPU: 2 - A100 80GB SXM
This happens on a Single Node. Both GPUs are on a single node.
```
…
-
**Please describe the bug**
When I tried to use alpa to parallelize llama-7b model on ray cluster (one node with 8 GPUs), disk space will continue to grow and never stop due to ray object spilling. F…
-
### System Info
- 4x A100 SXM 40GB
- CUDA 12.4
- Docker: nvidia/cuda:12.4.0-devel-ubuntu22.04
- TensorRT-LLM version: 0.10.0
### Who can help?
@kaiyux
### Information
- [x] The official exampl…
-
[INFO:1052 dmc:233 2022-07-20 17:39:38,765] After 1632000 (L:556800 U:528000 D:547200) frames: @ 1918.7 fps (avg@ 2318.1 fps) (L:0.0 U:0.0 D:1918.7) Stats:
{'loss_landlord': 1.9155352115631104,
'lo…
-
Maybe it can be a good idea to also release a llama version without fairscale layers. It is possible to run the 65B version using just 2 A100-SXM-80GB but this code forces you to use 8 GPUs no matter …
-
The Onkyo TX-NR709 has a favorite option they can custom stream links added to. I put the link http://192.168.1.200:8888/9486.m3u8 that works using VLC in the Onkyo and it generates the error informat…
-
Hi, I am newer to learn icefall,I finished the training of tdnn_lstm_ctc, when run the decode steps, I meet the following error, I change the --max-duration, there are still errors:
![image](https:…
-
Since yesterday I only get an exception when I tried to stream a channel.
28.Nov 2018 13:13:57 : Received error 100 Successful
----------------------------------------
Traceback (most recent ca…
ghost updated
5 years ago
-
Sorry late night playing with your awesome plugin here. Just trying to see if it would be possible to make the discord token a variable like the SXM Username and password that way I dont always have t…