Distributed DataParallel support

median-research-group / LibMTL

A PyTorch Library for Multi-Task Learning

MIT License

1.98k stars 185 forks source link

Closed prokaryote-hgy closed 9 months ago

prokaryote-hgy commented 9 months ago

Hi, nice project! I wonder when will LibMTL support Distributed DataParallel? It helps a lot!

Baijiong-Lin commented 9 months ago

Since many methods in LibMTL manipulate the gradients, DDP implementation will be complicated. We will work on it but it won't be supported soon.

Baijiong-Lin commented 9 months ago

Closed as no further updates.