pytorch / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.22k stars 863 forks source link

`weights_only` default flip for `torch.load` #3360

Open mikaylagawarecki opened 2 weeks ago

mikaylagawarecki commented 2 weeks ago

🐛 Describe the bug

We've flipped the default for the weights_only argument in torch.load to True in pytorch/pytorch, see here for details + documentation and this is coming in torch 2.6.

This is expected to be quite a BC-breaking change, especially if any torch.load calls are not loading plain tensors.

We should make sure that all the torch.load calls in torchserve are still working (see this PR https://github.com/pytorch/serve/pull/3073)

This should be merged before updating PyTorch version.

cc @agunapal @mreso