search

cylondata / cylon

Cylon is a fast, scalable, distributed memory, parallel runtime with a Pandas like DataFrame.
https://cylondata.org
Apache License 2.0
298 stars 48 forks source link

[PyTorch][Support] MPI Initialize Check for PyTorch #572

Open vibhatha opened 2 years ago

vibhatha commented 2 years ago

This is the corresponding PyTorch issue I created a while back. Currently the workaround is let PyTorch get initialized first and then Cylon. But once this issue is resolved it should be flexible.

https://github.com/pytorch/pytorch/issues/33943

vibhatha commented 2 years ago

This is an old example for PyTorch support: https://github.com/vibhatha/cylon_applications/blob/main/torch/pycylon_torch_example.py

As it is done, we initialize torch distributed prior to Cylon intialization.