NVIDIA / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
8.33k stars 1.39k forks source link

[64bit indexing][Adam] Add annotation to large tensor test #1772

Closed eqy closed 8 months ago

eqy commented 8 months ago

Memory reserved reaches ~56GiB here so going with 60GiB to be "safe"