NVIDIA / apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
BSD 3-Clause "New" or "Revised" License
8.42k stars 1.4k forks source link

[64bit indexing][Adam] Add annotation to large tensor test #1772

Closed eqy closed 10 months ago

eqy commented 10 months ago

Memory reserved reaches ~56GiB here so going with 60GiB to be "safe"