-
Do you (intend to) support multi gpu inference through the torch's nn.DataParallel class?
For example:
```
model = vqgan.VQModel(**config.model.params)
model = nn.DataParallel(model)
```
T…
-
How can I train models in multiple GPUs on the same machine. Current generic tf solution for keras API is using `tf.distribute.MirroredStrategy()` like below:
```
strategy = tf.distribute.Mirror…
-
I did a quick experiment using MNIST dataset. I noticed the performance of Tensorflow MacOS is pretty bad comparing to the CPU version/PlaidML.
### **Quick Stats**
**Tensorflow CPU (Standard):** 2…
-
I intended to train WaveNet with multi-GPU setting, since the hyper params in paper_hparams.py:
```
wavenet_batch_size=8
layers=24
hidden_size=512
```
will meet the OOM issue in single GPU setti…
-
Thanks for the code!
I wonder is there any way to train this model using 2 GPU. Right now I am training GQN with shepard_metzler_5_parts dataset and only 1 GPU is training.
-
Thanks for creating this comparison page. I think it will be usefull for many people.
Few comments:
1. CNTK Multi-GPU. The paper you mentioned only presents results for fully-connected networks. And i…
-
I use Tensorflow as the backend. And I use multi_gpu.py to achieve multi-gpus training. However, I find that the speed of using two gpus is almost same with using one gpu. Besides, I find when I use …
-
Hello. I have 2 questions about nuFHE.
1. I wanna connect several GPU to increase the speed of nuFHE. Is this possible?
2. I wanna compute 1 ciphertext and 1 encoding text before generating the ci…
Luidy updated
5 years ago
-
Hi,
First of all, thanks for the nice paper and release code. I am testing your model for a different dataset and two questions come up:
1. Which is the estimated number of epochs to train the mo…
-
주말 동안 transformers를 이용한 [LLaMA 6B](https://huggingface.co/docs/transformers/model_doc/llama#transformers.LlamaForCausalLM) 훈련을 시도하다가 현재 ambers 서버에 multi-GPU setting이 충분히 돼있지 않음을 확인하였습니다.
1. nccl 자체…