datavane / datasophon

The next generation of cloud-native big data management expert , Aims to help users rapidly build stable, efficient, and scalable cloud-native platforms for big data.
https://datasophon.github.io/datasophon-website/
Apache License 2.0
1.14k stars 393 forks source link

[Bug] [datasophon-worker] java.io.FileNotFoundException: /etc/security/keytab/keystore #398

Closed liuzx8888 closed 1 year ago

liuzx8888 commented 1 year ago

Search before asking

What happened

install hdfs error, Kerberos is off

e673d4e25f351644e8e73765ddd7358

What you expected to happen

[INFO] 2023-08-30 21:46:47 TaskLogLogger-HDFS-NameNode:[176] - STARTUP_MSG:   build = https://gitbox.apache.org/repos/asf/hadoop.git -r aa96f1871bfd858f9bac59cf2a81ec470da649af; compiled by 'brahma' on 2020-07-06T18:44Z
[INFO] 2023-08-30 21:46:47 TaskLogLogger-HDFS-NameNode:[176] - STARTUP_MSG:   java = 1.8.0_333
[INFO] 2023-08-30 21:46:47 TaskLogLogger-HDFS-NameNode:[176] - ************************************************************/
[INFO] 2023-08-30 21:46:47 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:47,290 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
[INFO] 2023-08-30 21:46:47 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:47,574 INFO namenode.NameNode: createNameNode [-bootstrapStandby]
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:48,037 INFO ha.BootstrapStandby: Found nn: nn1, ipc: hadoop1/192.168.1.180:8020
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:48,421 WARN web.URLConnectionFactory: Cannot load customized ssl related configuration. Fallback to system-generic settings.
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] - java.nio.file.NoSuchFileException: /etc/security/keytab/truststore
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at java.nio.file.Files.newByteChannel(Files.java:361)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at java.nio.file.Files.newByteChannel(Files.java:407)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at java.nio.file.Files.newInputStream(Files.java:152)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.security.ssl.ReloadingX509TrustManager.loadTrustManager(ReloadingX509TrustManager.java:170)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.security.ssl.ReloadingX509TrustManager.<init>(ReloadingX509TrustManager.java:88)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.security.ssl.FileBasedKeyStoresFactory.init(FileBasedKeyStoresFactory.java:220)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.security.ssl.SSLFactory.init(SSLFactory.java:180)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.web.SSLConnectionConfigurator.<init>(SSLConnectionConfigurator.java:50)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.web.URLConnectionFactory.getSSLConnectionConfiguration(URLConnectionFactory.java:100)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.web.URLConnectionFactory.newDefaultURLConnectionFactory(URLConnectionFactory.java:79)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.common.Util.<clinit>(Util.java:76)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getStorageDirs(FSNamesystem.java:1623)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNamespaceDirs(FSNamesystem.java:1578)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.parseConfAndFindOtherNN(BootstrapStandby.java:448)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:114)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:544)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1728)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] -  at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1821)
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:48,649 INFO common.Util: Assuming 'file' scheme for path /data/dfs/nn in configuration.
[INFO] 2023-08-30 21:46:48 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:48,719 INFO common.Util: Assuming 'file' scheme for path /data/dfs/nn in configuration.
[INFO] 2023-08-30 21:46:50 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:50,569 INFO ipc.Client: Retrying connect to server: hadoop1/192.168.1.180:8020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
[INFO] 2023-08-30 21:46:51 TaskLogLogger-HDFS-NameNode:[176] - 2023-08-30 21:46:51,571 INFO ipc.Client: Retrying connect to server: hadoop1/192.168.1.180:8020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

How to reproduce

version: master install hdfs

Anything else

No response

Version

main

Are you willing to submit PR?

Code of Conduct

datasophon commented 1 year ago

fix it at version 1.1.3