torch / nn

Other
1.34k stars 967 forks source link

Does the nn library use Tensor Core on Nvidia V100 GPU? #1294

Open michaelhuang74 opened 7 years ago

michaelhuang74 commented 7 years ago

Based on the guide on http://docs.nvidia.com/deeplearning/sdk/pdf/Training-Mixed-Precision-User-Guide.pdf, other frameworks such as NVCaffe, Caffe2, MXNet, PyTorch, TensorFlow and Theano will use the new Tensor Core on Nvidia V100 GPU for FP16 operations?

Does Torch7 use Tensor Core for FP16?

AlexeyAB commented 6 years ago

I'd like to know that, too.