Open thvasilo opened 6 years ago
@thvasilo Thanks for reporting this, can you try to submit a patch to this repo?
Hello @tqchen,
I started some work on bringing the code up-to-date with current EC2 standards/software here but I've run into trouble getting the HDFS/YARN distribution to work.
My recommendation to new users is to launch an EMR cluster with HDFS to avoid this complicated setup step and install/build XGBoost locally. I'm creating an automation script for that purpose currently.
As for simply changing the security groups in this repo I'll see if I can copy over the EMR-generated security groups and adjust them to work.
Hello @tqchen
I understand this repo is in maintenance mode now, but I wanted to point out that the security groups that it creates are too loose, exposing the yarn cluster to attacks.
I tried launching a cluster on EMR using these security groups and after a while I noticed jobs being submitted by "dr.who" and after investigation I found that a cryptominer was being run (using a conf file in /var/tmp/w attached below).
I'd recommend tightening the security as the current settings can pose a risk to users.