GoogleCloudDataproc / bdutil

[DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine
https://cloud.google.com/dataproc
Apache License 2.0
109 stars 94 forks source link

libsnappy1 has been replaced and jdk updated for debian 9 #116

Open algarecu opened 4 years ago

algarecu commented 4 years ago

libsnappy1 has been replaced with libsnappy1v5 in Debian 9 Stretch and JDK version must be up to date to 11.

googlebot commented 4 years ago

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

:memo: Please visit https://cla.developers.google.com/ to sign.

Once you've signed (or fixed any issues), please reply here with @googlebot I signed it! and we'll verify it.


What to do if you already signed the CLA

Individual signers
Corporate signers

ℹ️ Googlers: Go here for more info.

googlebot commented 4 years ago

CLAs look good, thanks!

ℹ️ Googlers: Go here for more info.

algarecu commented 4 years ago

Managed to install correctly on Debian 9 Stretch after the above fixes.

Fri Nov 15 22:10:38 CET 2019: Step 'deploy_start2,*' done... Fri Nov 15 22:10:38 CET 2019: Command steps complete. Fri Nov 15 22:10:38 CET 2019: Execution complete. Cleaning up temporary files... Fri Nov 15 22:10:38 CET 2019: Cleanup complete. Fri Nov 15 22:10:38 CET 2019: To log in to the master:

medb commented 4 years ago

Thanks for contribution. But bdutil has been deprecated in favor of Cloud Dataproc and doesn't accept new changes anymore.

Please use Cloud Dataproc that supports [Debian 9]() out fo the box.

algarecu commented 4 years ago

Thanks for contribution. But bdutil has been deprecated in favor of Cloud Dataproc and doesn't accept new changes anymore.

Please use Cloud Dataproc that supports Debian 9 out fo the box.

Thanks copy that, but can Cloud Dataproc deploy HDP Ambari environments? If the answer is yes great and if not I may keep on using bdutil for internal use as long as we are on Google. That was the initial motivation/need. Nevertheless, I am happy finding bugs in public software repositories but I will obviously share any more findings in my own bdutil repo if required from now on. Bdutil is still a useful tool to me despite the novelty. Cheers.

medb commented 4 years ago

Right now Dataproc does not support Ambari, so unless you are willing to embrace Dataproc as a managed service with its APIs and idioms instead of Ambari it will not work for you.

Feel free to send PRs if they could be useful for others, but we will not be able to merge them.

Out of curiosity, do you rely on specific Amabari features that are not available on Dataproc?