Put model to default device before initializing optimizer

apple / pfl-research

Simulation framework for accelerating research in Private Federated Learning

http://apple.github.io/pfl-research/

Apache License 2.0

281 stars 27 forks source link

Put model to default device before initializing optimizer #76

Closed grananqvist closed 2 months ago

grananqvist commented 3 months ago

Put model to default device before initializing optimizer, because otherwise this would crash for an optimizer like AdaGrad, complaining that optimizer tensors are on cpu, not model tensors are on gpu.

grananqvist commented 3 months ago

something wrong with poetry.lock...