dividiti / ck-caffe

Collective Knowledge workflow for Caffe to automate installation across diverse platforms and to collaboratively evaluate and optimize Caffe-based workloads across diverse hardware, software and data sets (compilers, libraries, tools, models, inputs):
http://cKnowledge.org
BSD 3-Clause "New" or "Revised" License
193 stars 40 forks source link

Unifying CUDA/cuDNN packages #56

Closed gfursin closed 7 years ago

gfursin commented 7 years ago

At some point, we need to convert lib-caffe-bvlc-master-cuda & lib-caffe-bvlc-master-cudnn to the universal installer format similar to lib-caffe-bvlc-opencl-viennacl-universal to support both Linux and Windows. Help is appreciated.

psyhtest commented 7 years ago

After removing the useless fp16-emu packages, we have the following:

$ ck search package --tags=lib,caffe,vcuda                        
ck-caffe:package:lib-caffe-bvlc-opencl-libdnn-cuda
ck-caffe:package:lib-caffe-nvidia-fp16-cuda
ck-caffe:package:lib-caffe-nvidia-0.15-cuda
ck-caffe:package:lib-caffe-bvlc-master-cuda
$ ck search package --tags=lib,caffe,vcudnn
ck-caffe:package:lib-caffe-bvlc-master-cudnn
ck-caffe:package:lib-caffe-nvidia-0.15-cudnn
ck-caffe:package:lib-caffe-nvidia-fp16-cudnn

lib-caffe-bvlc-opencl-libdnn-cuda is actually a libDNN package that happens to use CUDA. I would suggest to unify it similarly to lib-caffe-bvlc-opencl-libdnn-clblast-universal.

The lib-caffe-nvidia-fp16-cuda/cudnn packages use the stale fp16 experimental branch that might not support recent CMake changes. I would wait until the OpenCL branch supports fp16, and then get rid of them.

This leaves lib-caffe-bvlc-master-cuda/cudnn and lib-caffe-nvidia-0.15-cuda/cudnn packages for unification.

DVEfremov commented 7 years ago

Looks like it works now for ubuntu lib-caffe-bvlc-master-cuda-universal and lib-caffe-bvlc-master-cudnn-universal

DVEfremov commented 7 years ago

I have no windows with cuda support so I cant check it for windows. Need help here.

gfursin commented 7 years ago

I believe I fixed all that. I close this ticket and we will open a new one if there are issues ... Thanks!