search

neuralmagic / sparsify

ML model optimization product to accelerate inference.
Apache License 2.0
318 stars 28 forks source link

[BUG] Update `DDP_ENABLED` flag #249

Closed dsikka closed 1 year ago

dsikka commented 1 year ago

Summary:

For this ticket - https://app.asana.com/0/1204777926187571/1204947833549381/f

We want to only enable DDP if cuda/gpus are available. Ticket relates to the way WORLD_SIZE is set by pytorch during cpu distributed training.