-
Trying to create a spark notebook connecting to the cloudera sandbox running on CentOS 7.
Repeatedly get the error that file /tmp/spark-93b-......../__spark__conf*.zip does not exist
I can see that th…
-
```
from pyarrow import fs
hdfs, _ = fs.FileSystem.from_uri('hdfs://haruna')
```
when i use this type of code to create a connect, it raise this error
```
hdfs, _ = fs.FileSystem.from_uri(…
-
/opt/datasophon/flink-1.15.2/bin/flink run -t yarn-per-job /opt/datasophon/flink-1.15.2/examples/batch/WordCount.jar --input /test/input/word.txt --output /test/output/fwordcount/
SLF4J: Class p…
-
I tried to run the joblib_yarn_parallel.py file and got an error(https://github.com/joblib/joblib-hadoop/blob/master/examples/joblib_yarn_parallel.py):
(/tmp/joblib_yarn_conda_env) [opc@brora1vudap…
-
Hi, I'm running SONA-example，and got FAILED with stdout log here.
PLEASE HELP~~
```
2019-12-26 14:09:19 INFO SignalUtils:54 - Registered signal handler for TERM
2019-12-26 14:09:19 INFO SignalU…
-
hadoop bin /home/hadoop/hadoop-3.1.1/bin/hadoop
CMD: /home/hadoop/hadoop-3.1.1/bin/hadoop jar /usr/bin/xdl-yarn-scheduler-1.0.0-SNAPSHOT-jar-with-dependencies.jar com.alibaba.xdl.Client -c=config.jso…
-
init spark on yarn with ray, automl yarn-client mode couldn't find hadoop command, when hadoop is not in default linux PATH. Apache hadoop has this problem, while CDH does't have.
```
ray::ImplicitF…
-
I used the author's ds2hdfs.py script to collect dolphinscheduler log files and upload them to hdfs. I found that there are many flume java programs running. Please tell me how to stop。
For example: …
-
-
yarn队列问题，查看spark-enginemanage的log文件，报错内容如下：
```
ERROR [qtp1670196451-332] com.webank.wedatasphere.linkis.rpc.RPCReceiveRestful 72 apply - error code(错误码): 111006, error message(错误信息): Get the Yarn …