search

rancher / community-catalog

Catalog entries contributed by the community
384 stars 636 forks source link

Hadoop “Unable to load native-hadoop library for your platform” warning #698

Open gnanasekar6914 opened 6 years ago

gnanasekar6914 commented 6 years ago

I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error:

WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

I'm running Hadoop 2.2.0.

Doing a search online brought up this link: http://balanceandbreath.blogspot.ca/2013/01/utilnativecodeloader-unable-to-load.html

However, the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.

I've also added these two environment variables in hadoop-env.sh:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"

export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

Any ideas?

pinsily commented 6 years ago

hi,man I also have the same problem with you and i copy your environment variables to my hadoop-env.sh, but some different below:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/native"

export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/"

obvious that i append /native to the HADOOP_OPTS, expert this to help you