search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.57k stars 3.25k forks source link

[Bug]Hadoop high availability is currently not supported[Bug] #9129

Open cnmrzhou opened 2 years ago

cnmrzhou commented 2 years ago

Search before asking

Version

1.0

What's Wrong?

use hive external table on thrift ,but response message: ERROR 1105 (HY000): errCode = 2, detailMessage = connect failed. hdfs://nameservice2

What You Expected?

use hive external table on thrift ,but response message: ERROR 1105 (HY000): errCode = 2, detailMessage = connect failed. hdfs://nameservice2

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

Code of Conduct

Jibing-Li commented 2 years ago

The following hdfs ha related configuration items are missing.

        ("dfs.nameservices", "hacluster");
        ("dfs.ha.namenodes.hacluster", "3,4");
        ("dfs.namenode.rpc-address.hacluster.3", "192.168.0.93:8020");
        ("dfs.namenode.rpc-address.hacluster.4", "192.168.0.189:8020");
        ("dfs.client.failover.proxy.provider.hacluster", "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider");

Need to find a way to pass the above parameters to Doris hive external table. We will fix this very soon.

wangmiao1002 commented 2 years ago

以下hdfs ha相关配置项缺失。

        ("dfs.nameservices", "hacluster");
        ("dfs.ha.namenodes.hacluster", "3,4");
        ("dfs.namenode.rpc-address.hacluster.3", "192.168.0.93:8020");
        ("dfs.namenode.rpc-address.hacluster.4", "192.168.0.189:8020");
        ("dfs.client.failover.proxy.provider.hacluster", "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider");

需要想办法把上面的参数传给Doris hive外部表。我们将很快解决这个问题。

Jibing-Li commented 2 years ago

https://github.com/apache/incubator-doris/pull/9151