search

Spirals-Team / hadoop-benchmark

Docker containers to build an Hadoop infrastructure and experiment feedback control loops atop of it.
Apache License 2.0
9 stars 5 forks source link

Support Windows #9

Open fikovnik opened 7 years ago

fikovnik commented 7 years ago

Currently, the project has only been tested on Linux and OSX. It should also work on Windows. Once anyone has an access to a Windows machine, it would be great to give it a try.

BenediktEberhardinger commented 7 years ago

I am currently working on a setup with Windows 10 (with MINGW shell) and got the following issue: The cluster.sh is initialized with the "mycluster" config provided (but with 2 compute nodes) and the create-cluster command works fine (all machines are listed running). However, the start-hadoop command ends in the loop of wait_for_port() by waiting for the ResourceManager that is not responding. Do you have any ideas what might cause that issue? Thanks for your help!

fikovnik commented 7 years ago

We have never tried that on windows. can you check the logs from the running docker containers?

BenediktEberhardinger commented 7 years ago

Alas, there are no logs that have been created since the Docker Container wasn't started properly. The issue is that Docker in Windows 10 environment requires Hyper-V, but after activating Hyper-V VirtualBox is not long working on Windows 10. Which causes the script for Docker Machine VirtualBox setup to fail: the computer suddenly powers off and restarts during execution of the shell scripts. According to a post by Docker (https://forums.docker.com/t/running-docker-and-virtualbox-on-the-same-machine/23578) it seems that Docker and VirtualBox couldn't be executed on the same Windows 10 machine together.