search

yahoo / CaffeOnSpark

Distributed deep learning on Hadoop and Spark clusters.
Apache License 2.0
1.27k stars 358 forks source link

CaffeOnSpark as maven package #108

Open anfeng opened 8 years ago

anfeng commented 8 years ago

Since multiple users have faced build problems, it might be better to offer CoS as maven package, similar to lmdbjni.

We need to nail down a list of supported OS. Any input?

guchensmile commented 8 years ago

The build error from my scenario is misunderstanding on https://github.com/yahoo/CaffeOnSpark/wiki/build

1) Install caffe prerequists per http://caffe.berkeleyvision.org/installation.html I even install caffe not only the caffe prerequists 2) Clone CaffeOnSpark code git clone https://github.com/yahoo/CaffeOnSpark.git --recursive another careless is to forget clone with --recursive

My setup OS is linux mint 17.2 similar with ubuntu version. The most popular server maybe CetOS.

arundasan91 commented 8 years ago

Hello,

I would like to point out that the build problems are because the host systems do not have maven installed. I am not sure if CaffeOnSpark installs it for you during any stage. I faced build errors everytime I try to set up a cluster.

An added step, sudo apt-get maven before make build will ensure a clean build, hopefully for everyone.

Thanks, Arun

guchensmile commented 8 years ago

Hello anfeng,

Another suggestion is the maven package can be compiled separately as Server which contain no GPU and Client which used for compute task by GPU/CPU