search

yahoo / CaffeOnSpark

Distributed deep learning on Hadoop and Spark clusters.
Apache License 2.0
1.27k stars 357 forks source link

Error: Exception in thread "main" java.lang.UnsatisfiedLinkError: no lmdbjni in java.library.path #228

Open malia05 opened 7 years ago

malia05 commented 7 years ago

I installed linux UBUNTU 32 bits in my laptop, I successful installed Spark-1.6.0 and CaffeOnSaprk , and I create train and test mnist lmdb, but when I run submit to train mnist lmdb, Spark display Exception in thread "main" java.lang.UnsatisfiedLinkError: no lmdbjni in java.library.path.... plz can someone help me,,,,, and thank you so muchhh

arundasan91 commented 7 years ago

Hi @malia05 ,

If all the tests passed successfully while building CoS, make sure you have set all the PATH's correctly. If you are using a Mac, then check DYLD_LIBRARY_PATH and for ubuntu check LD_LIBRARY_PATH.

If you just export the variables one time, those variables will be reset when you reboot your system. Please add these lines to your .bash_profile or a similar file.

export DYLD_LIBRARY_PATH=${CAFFE_ON_SPARK}/caffe-public/distribute/lib:${CAFFE_ON_SPARK}/caffe-distri/distribute/lib
export DYLD_LIBRARY_PATH=${DYLD_LIBRARY_PATH}:/usr/local/cuda/lib:/usr/local/mkl/lib/intel64/
export LD_LIBRARY_PATH=${DYLD_LIBRARY_PATH}

This will export the variables every time you log in to your user account.

Please let me know if it helped.

Thanks, Arun