-
We've seen spark job stucked with following trace:
java.util.HashMap.put(HashMap.java:494)
org.apache.hadoop.conf.Configuration.set(Configuration.java:1065)
org.apache.hadoop.conf.Configuration.set(C…
-
Hi,
I'm trying to use RHive to connect with Hive offered on Hortonwork's Data Platform 2.2 (HDP 2.2) virtual box image.
Here is my current setup:
``` R
install.packages("RHive")
Sys.setenv(HIVE_HO…
-
Hi All,
I am trying to run basic mapreduce example in R using rmr2 and rhdfs libraries, but I am getting an error. Single node hadoop cluster is installed properly and all five demeans are starting p…
-
Hi,
I have tried a few things and feel I have configured my machine in a way that reflects what is specified in the quickstart guide, but I am running into a few issues. I can complete the install …
-
Hi,
when I try to write parquet file into HDFS, I have below issue:
File /data_set/hello/crm_last_month/2534cb7a-fc07-401e-bdd3-2299e7e657ea.parquet could only be replicated to 0 nodes instead of…
-
2022-07-16 17:13:43,182 ERROR [DataXceiver for client DFSClient_attempt_1657804987000_15524_m_000040_0_-1450386456_1 at /172.16.9.143:36326 [Receiving block BP-12047675-172.16.9.141-1608793845868:blk_…
-
We plan to implement these features in a two phase solution:
**Phase I** : _Implement the kill task feature_
Currently on killing the Hadoop ingestion task from the overlord ui does not kill the…
-
### 도커 컴포즈 실패
도커 컴포즈를 통해 컨테이너를 실행하려고 하니 다음과 같이 바로 종료되었다.
아마도 문제는 도커 컴포즈로 컨테이너를 동시에 띄우는 과정에서 무슨 설정에 문제가 있는게 아닐까 싶은데...
내가 도커 컴포즈에 대한 이해가 부족하다보니 조금 더 알아보고 이해하는 시간이 필요해보인다.
### docker-compose 실행 …
-
start-hadoop doesn't start node manager and data node. ony start resource manager
root@hadoop-master:~# $HADOOP_HOME/sbin/start-dfs.sh
Starting namenodes on [hadoop-master]
hadoop-master: Warning…
-
spark-1.6.2-bin-hadoop2.6, elasticsearch-5.0.0-beta1, elasticsearch-hadoop-5.0.0-beta1
``` bash
curl -XPOST localhost:9200/test4/test -d '{"b":0,"e":{"f.g":"hello"}}'
./bin/pyspark --driver-class-pat…