4paradigm / OpenMLDB

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.
https://openmldb.ai
Apache License 2.0
1.59k stars 321 forks source link

hadoop.conf.dir env bug #3926

Open vagetablechicken opened 6 months ago

vagetablechicken commented 6 months ago

https://github.com/4paradigm/OpenMLDB/blob/6569b42f81cb57393858b74b0658b02ae465d527/java/openmldb-taskmanager/src/main/scala/com/_4paradigm/openmldb/taskmanager/spark/SparkJobManager.scala#L48

After 1792700a97 , sparklauncher miss the env, so 0.8.3<=version<=0.9.0 can't use hadoop.conf.dir in taskmanager config.