search

Lightning-AI / pytorch-lightning

Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
https://lightning.ai
Apache License 2.0
28.49k stars 3.39k forks source link

Does Pytorch-Lightning support the task of federated learning? #7715

Closed marsggbo closed 3 years ago

marsggbo commented 3 years ago

Does Pytorch-Lightning support the task of federated learning? If so, any example provided? Thanks!

kaushikb11 commented 3 years ago

@tchaton Your take?

tchaton commented 3 years ago

Hey @marsggbo,

We worked on a first integration with PySyft. Here is the notebook: https://github.com/OpenMined/PySyft/blob/dev/packages/syft/examples/duet/mnist_lightning/MNIST_Lightning_Syft_Data_Scientist.ipynb

Only works for CPU right now.

They are currently working on Plan which make remote training way faster.

We will resume our collaboration in 1-2 month time.

Best, T.C