eth-easl / modyn

Modyn is a research-platform for training ML models on dynamic datasets.
MIT License
22 stars 3 forks source link

Fix device for initial RHO-LOSS tensor #525

Closed MaxiBoether closed 2 weeks ago

MaxiBoether commented 2 weeks ago

The initial tensor resides on CPU. For me, it failed when running RHO-LOSS, since the very first self.rho_loss = torch.cat([self.rho_loss, training_loss - irreducible_loss]).to(training_loss.dtype) was on two different devices, the CPU (initial tensor) and the GPU (training loss and IR loss). This PR fixes that by moving the initial tensor to the correct device.

github-actions[bot] commented 2 weeks ago

Line Coverage: -% ( % to main) Branch Coverage: -% ( % to main)