search

amplab / SparkNet

Distributed Neural Networks for Spark
MIT License
603 stars 172 forks source link

SparkNet for CPU-only clusters #110

Closed ravi9 closed 8 years ago

ravi9 commented 8 years ago

Could you provide SparkNet for CPU-only clusters ?

robertnishihara commented 8 years ago

Hi Ravi, we built some jars without CUDA. It should work if you try changing the relevant lines in build.sbt to

resolvers += "javacpp" at "http://www.eecs.berkeley.edu/~rkn/snapshot-2016-03-16-CPU/"

libraryDependencies += "org.bytedeco" % "javacpp" % "1.2-SPARKNETCPU"

libraryDependencies += "org.bytedeco.javacpp-presets" % "caffe" % "master-1.2-SPARKNETCPU"

libraryDependencies += "org.bytedeco.javacpp-presets" % "caffe" % "master-1.2-SPARKNETCPU" classifier "linux-x86_64"

libraryDependencies += "org.bytedeco.javacpp-presets" % "opencv" % "3.1.0-1.2-SPARKNETCPU"

libraryDependencies += "org.bytedeco.javacpp-presets" % "opencv" % "3.1.0-1.2-SPARKNETCPU" classifier "linux-x86_64"

libraryDependencies += "org.bytedeco.javacpp-presets" % "tensorflow" % "master-1.2-SPARKNETCPU"

libraryDependencies += "org.bytedeco.javacpp-presets" % "tensorflow" % "master-1.2-SPARKNETCPU" classifier "linux-x86_64"

Basically, change the URL to snapshot-2016-03-16-CPU and change all of the instances of SPARKNET to SPARKNETCPU.

ravi9 commented 8 years ago

Great! Thanks. I will try it out.

robertnishihara commented 8 years ago

Closing because this is addressed. Please reopen if you encounter a problem.

ravi9 commented 8 years ago

Sure, thanks.

javadba commented 8 years ago

Is the March 16 snapshot still the best way to get cpu only?

robertnishihara commented 8 years ago

Yes, it is.

skmishra5 commented 7 years ago

Hi,

I am also trying to build for CPU only clusters. I changed the URL to snapshot-2016-03-16-CPU and change all of the instances of SPARKNET to SPARKNETCPU as instructed above. But it still gives me the below error.

[error] (*:update) sbt.ResolveException: unresolved dependency: org.bytedeco#javacpp;1.2-SPARKNETCPU: not found [error] unresolved dependency: org.bytedeco.javacpp-presets#caffe;master-1.2-SPARKNETCPU: not found [error] unresolved dependency: org.bytedeco.javacpp-presets#opencv;3.1.0-1.2-SPARKNETCPU: not found [error] unresolved dependency: org.bytedeco.javacpp-presets#tensorflow;master-1.2-SPARKNETCPU: not found

Kindly help me with this.

Thanks and Regards, Sitakanta Mishra

rawar-zz commented 7 years ago

+1