search

NEGU93 / cvnn

Library to help implement a complex-valued neural network (cvnn) using tensorflow as back-end
https://complex-valued-neural-networks.readthedocs.io/
MIT License
164 stars 34 forks source link

Data Parallel Distributed support #45

Closed raj-brown closed 10 months ago

raj-brown commented 10 months ago

Dear All- Can I use torch.nn.DataParallel routine to train neural network for large complex value data.

Thanks! Raj

NEGU93 commented 10 months ago

I am quite unfamiliar with pytorch. This library uses tensorflow instead. It is supposed to already work with GPU anyway, so should not be necessary.

raj-brown commented 10 months ago

@NEGU93 So I can use HOROVOD type of Framework for this. Right?

NEGU93 commented 10 months ago

Again I ignore what HORVOD is. I won't be able to help you in this matter.

NEGU93 commented 10 months ago

Just a precision. My library is supposed to support everything that tensorflow supports. If you use HOROVOD with tensorflow, it should work with my library too.

If it doesn't, you can creat an issue with the specific problem.

(This also applies with torch parallel but I seriously doubt you can actually use tf and pytorch together in that way).