Installed docker container, but when I try to connect to it, I am getting auth errors.
I tried to enable simple auth but the docs are not lining up to what I see installed.
Error message
SIMPLE authentication is not enabled. Available:[TOKEN]
$ hadoop fs -fs hdfs://192.168.99.100:32846 -ls
16/02/07 15:11:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: SIMPLE authentication is not enabled. Available:[TOKEN]
I am getting the same error from Spark
final SparkConf sparkConfig = new SparkConf().setAppName("baseball");
if (args.length == 0) {
sparkConfig.setMaster("local[4]");
}
final JavaSparkContext sparkContext = new JavaSparkContext(sparkConfig);
//final JavaRDD<String> lines = sparkContext.textFile("/opt/baseball/Master.csv");
final JavaRDD<String> lines = sparkContext.textFile("hdfs://192.168.99.100:32846/opt/baseball/Master.csv");
final JavaRDD<String> noHeader = lines.filter(line -> !line.startsWith("playerID"));
Exception in thread "main" org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled. Available:[TOKEN]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1681)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106)
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
Installed docker container, but when I try to connect to it, I am getting auth errors. I tried to enable simple auth but the docs are not lining up to what I see installed.
Error message
I am getting the same error from Spark