-
Hi how to use multi gpu for inference. Thanks
-
Thanks for the open source. I run vos_inference.py with my own video dataset on a machine with four v100 graphics cards (each with 32G memory). I detected that the program is only running on one card.…
-
CI test **linux://rllib:learning_tests_multi_agent_pendulum_sac_multi_gpu** is consistently_failing. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/5994#01918161-64d5-42a6-ad4…
-
The DAT model can be very heavy, even on a 3090, when a lots of images needs to be upscalled. Is there any chance you could implements multi-gpu in order for a second card to be active ?
I have no …
-
### System Info
- `transformers` version: 4.44.0
- Platform: Linux-6.5.0-15-generic-x86_64-with-glibc2.35
- Python version: 3.10.14
- Huggingface_hub version: 0.24.5
- Safetensors version: 0.4.4
…
-
When can we expect code update for GPU-based pre-training and fine-tuning instead of TPU? @ellisbrown @penghao-wu @tsb0601
-
### Bug description
I'm trying to use the Streaming library by Mosaic as described in the doc (https://lightning.ai/docs/pytorch/stable/data/alternatives.html) but it doesn't work as seamlessly as ex…
-
Hi. I have a desktop that has 2x Tesla T4s, and it should be working because it has 32G VRAM in total, while other people reported to have a 27G VRAM usage when inferring. It should work but when infe…
D3lik updated
3 months ago
-
I tried to run the demo on multiple RTX 3090 but got strange errors:
```
python3.10/site-packages/transformers/cache_utils.py", line 146, in update
self.key_cache[layer_idx] = torch.cat([self.k…
-
how can i run the infer on multi gpus?