search

martinprobson / vagrant-hadoop-hive-spark

Vagrant project to spin up a single node VM running current versions of Hadoop, Hive and Spark
Apache License 2.0
67 stars 59 forks source link

sqoop: command not found error #25

Open lekeCoder opened 3 years ago

lekeCoder commented 3 years ago

I followed the steps in the README doc and all went pretty well except for sqoop and flume. When l try to run sqoop command l keep getting this error: sqoop not found after running vagrant ssh.

I am on Mac, sqoop 1.4.6. Spark 2.3.0

any help is appreciated

Screen Shot 2021-08-29 at 7 40 08 AM

During setup, this what l noticed.

Screen Shot 2021-08-29 at 7 58 36 AM
martinprobson commented 3 years ago

Hello @lekeCoder - I think this is because sqoop has gone into the Apache attic (i.e. it is no longer actively maintained by the Apache team - see this link ). Therefore the download is no longer available from the default location. Do you still need to use sqoop? If not you can just comment out the sqoop installation part in the VagrantFile : -

 node.vm.provision :shell, path: 'scripts/setup-pig.sh'
        node.vm.provision :shell, path: 'scripts/setup-flume.sh'
        node.vm.provision :shell, path: 'scripts/setup-sqoop.sh'  # comment out this line with '#'
        node.vm.provision :shell, path: 'scripts/setup-zeppelin.sh'

Or you can use the master branch which already has sqoop commented out. If you still need to use sqoop in your VM then I can try and track down an alternative mirror.

lekeCoder commented 3 years ago

@martinprobson thank you for responding and offering to help. unfortunately, l still need sqoop. hopefully you will find a working sqoop package.