search

BVLC / caffe

Caffe: a fast open framework for deep learning.
http://caffe.berkeleyvision.org/
Other
34.13k stars 18.68k forks source link

Tensorcore / Volta Support? #6439

Open soulslicer opened 6 years ago

soulslicer commented 6 years ago

Does Caffe support Tensorcore / Volta? There is a post on the Google Group saying its possible, but I'm not sure if it has been implemented

Noiredd commented 6 years ago

You have likely read this post. For now, this hasn't been implemented yet. We need someone with a Volta device and enough spare time to implement and test this.

soulslicer commented 6 years ago

yes you are right. i really hope someone can do this one day

beniz commented 6 years ago

Nvidia caffe has support for 16bit precision and tensorcores AFAIK. The former is a lots of code to merge back into caffe.

naibaf7 commented 6 years ago

@beniz The 16 bit support is much improved on the OpenCL branch, working for both nVidia and AMD and Intel and ARM GPUs actually ;)

beniz commented 6 years ago

@naibaf7 Fantastic! We're maintaining https://github.com/jolibrain/caffe that supports a large variety of applications, though lacks a bit behind Caffe for multi-GPU perf. 16bit would be very welcome, though we're slowly migrating to Caffe2 (https://github.com/jolibrain/deepdetect/pull/464). I guess you are referring to https://github.com/naibaf7/caffe/tree/master as your current OpenCL version ?

Could you PM me for discussing these matters further ? Thanks!