search

h2oai / sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster
https://docs.h2o.ai/sparkling-water/3.3/latest-stable/doc/index.html
Apache License 2.0
968 stars 360 forks source link

libxgboost.so getting filled in /tmp #5708

Open kalaiselvan263 opened 9 months ago

kalaiselvan263 commented 9 months ago

Support

https://support.h2o.ai/a/tickets/107089

We need to figure out the way to change the tmp path for ligxgboost.so

https://discuss.xgboost.ai/t/native-libraries-dll-so-dylib-not-removed-from-temp-folder/3013

valenad1 commented 8 months ago

The temp folder can be changed with -Djava.io.tmpdir

java -Djava.io.tmpdir=newtemp h2o.jar

Temp is cleared after the h2o is closed.

FengAtH2O commented 8 months ago

I think the problem is if h2o cluster is not shutting down normally ( for example, crashed) , this file won't be cleared.

valenad1 commented 8 months ago

Could be the reason, I cannot simulate it on my local though. The tmp is cleared when I kill the java.. the different tmp could be the solution to these cases.

kalaiselvan263 commented 8 months ago

@valenad1 We have tried to change the tmp location, however it is not picking up the different tmp folder.

kalaiselvan263 commented 8 months ago

Customer is using 3.40.0.1 SW version

valenad1 commented 7 months ago

@krasinski Can you check how to redirect tmp folder for SW?

kalaiselvan263 commented 6 months ago

@valenad1 Can you please confirm if the files can be cleaned periodically.

valenad1 commented 6 months ago

Server can run script and clean periodically the tmp folder if it is what you mean. We don't have anything like that built-in. But @krasinski is more experienced with SW.