-
I can't seem to use multiple gpus
There are two gpus in the setup, but training seems to be done on only one gpu causing out of memory
How can this situation be resolved?
-
Hi, I tried to run a python code that would use multiple GPUs. It is a Pytorch inference model that loads on a Gpu to classify an image.
I used the mp.Pool(NUM_FUNCTIONS), but each process uses the …
-
## Describe the bug
I am currently building the model from the source for the model - `meta-llama/Meta-Llama-3-8B-Instruct`:
```
ckpt_path = checkpoints[get_model_parallel_rank()]
checkpoint = tor…
-
I ran into OOM error to train a huge data. I have 4 GPUs, and I wonder if there's a way to use multiple gpus?
-
### System Info
peft=0.11.1
python=3.10
### Who can help?
When I run this script, there is no problem with a single GPU. When I try to run 2 GPUs, the system resources show that the utilizat…
-
-
This was discussed fairly thoroughly in #426, the issue to add GPU support, but that's been fixed, so figured I'd open a new issue to keep this particular feature visible.
I have multiple GPUs, and…
-
Hi - can is there multi gpu support for Diffutoon inference?
-
Dear Dr. Huang
I am reading your code SA_PINN_Poisson2D.ipynb (Solving 2D Poisson Equation with SA-PINN).
I download the code and it runs successfully, thanks for sharing your code.
Do you have any…
-
### Your current environment
```text
(vllm) nd600@PC-7C610BFD7B:~$ python collect_env.py
Collecting environment information...
/home/nd600/miniconda3/envs/vllm/lib/python3.10/site-packages/torch…