search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.49k stars 4.89k forks source link

Minikube not starting in Azure VM #2084

Closed sdixonbigdog closed 6 years ago

sdixonbigdog commented 7 years ago

Is this a BUG REPORT or FEATURE REQUEST? (choose one): BUG REPORT

Please provide the following details: Environment: Microsoft Azure Size: Standard D2s v3 (2 vcpus, 8 GB memory)

Minikube version (use minikube version): v0.22.3

echo ""; echo "ISO version"; grep -i ISO ~/.minikube/machines/minikube/config.json

What happened: PS C:\Windows\system32> minikube status minikube: Running cluster: Stopped kubectl: Correctly Configured: pointing to minikube-vm at fe80::215:5dff:fe00:40f

What you expected to happen: PS C:\Windows\system32> minikube status minikube: Running cluster: Running kubectl: Correctly Configured: pointing to minikube-vm at fe80::215:5dff:fe00:40f

How to reproduce it (as minimally and precisely as possible): Create VM in Azure (Windows 10 EE, size Standard D2s v3 (2 vcpus, 8 GB memory). Install Docker for Windows (v 17.09.0-ce), install minikube, install kubectl.

Run: minikube.exe start --kubernetes-version="v1.7.5" --vm-driver="hyperv" --memory=2048 --hyperv-virtual-switch="Primary Virtual Switch" --v=7 --alsologtostderr

Output of minikube logs (if applicable): Windows PowerShell Copyright (C) 2016 Microsoft Corporation. All rights reserved.

PS C:\Windows\system32> minikube.exe start --kubernetes-version="v1.7.5" --vm-driver="hyperv" --memory=2048 --hyperv-vir
tual-switch="Primary Virtual Switch" --v=7 --alsologtostderr
W1018 16:17:13.636703    4516 root.go:148] Error reading config file at C:\Users\sdixon\.minikube\config\config.json: op
en C:\Users\sdixon\.minikube\config\config.json: The system cannot find the file specified.
I1018 16:17:13.644703    4516 cache_images.go:226] Attempting to cache image: gcr.io/google_containers/pause-amd64:3.0 a
t C:\Users\sdixon\.minikube\cache\images\gcr.io\google_containers\pause-amd64_3.0
I1018 16:17:13.645709    4516 cache_images.go:226] Attempting to cache image: gcr.io/google_containers/kubernetes-dashbo
ard-amd64:v1.6.3 at C:\Users\sdixon\.minikube\cache\images\gcr.io\google_containers\kubernetes-dashboard-amd64_v1.6.3
Starting local Kubernetes v1.7.5 cluster...
Starting VM...
I1018 16:17:13.645709    4516 cache_images.go:226] Attempting to cache image: gcr.io/google_containers/k8s-dns-kube-dns-
amd64:1.14.4 at C:\Users\sdixon\.minikube\cache\images\gcr.io\google_containers\k8s-dns-kube-dns-amd64_1.14.4
I1018 16:17:13.645709    4516 cache_images.go:226] Attempting to cache image: gcr.io/google_containers/k8s-dns-dnsmasq-n
anny-amd64:1.14.4 at C:\Users\sdixon\.minikube\cache\images\gcr.io\google_containers\k8s-dns-dnsmasq-nanny-amd64_1.14.4
I1018 16:17:13.645709    4516 downloader.go:56] Not caching ISO, using https://storage.googleapis.com/minikube/iso/minik
ube-v0.23.5.iso
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive @(Get-Command Get
-VM).ModuleName
I1018 16:17:13.646708    4516 cache_images.go:226] Attempting to cache image: gcr.io/google_containers/k8s-dns-sidecar-a
md64:1.14.4 at C:\Users\sdixon\.minikube\cache\images\gcr.io\google_containers\k8s-dns-sidecar-amd64_1.14.4
I1018 16:17:13.646708    4516 cache_images.go:226] Attempting to cache image: gcr.io/google-containers/kube-addon-manage
r:v6.4-beta.2 at C:\Users\sdixon\.minikube\cache\images\gcr.io\google-containers\kube-addon-manager_v6.4-beta.2
I1018 16:17:13.647704    4516 cache_images.go:77] Successfully cached all images.
[stdout =====>] : Hyper-V

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive @([Security.Princ
ipal.WindowsPrincipal][Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole("Hyper-V Administrators")
[stdout =====>] : False

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive @([Security.Princ
ipal.WindowsPrincipal][Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole([Security.Principal.WindowsBuiltInRol
e] "Administrator")
[stdout =====>] : True

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (Get-VMSwitch).Na
me
[stdout =====>] : Layered_Ethernet
Primary Virtual Switch
DockerNAT

[stderr =====>] :
Downloading C:\Users\sdixon\.minikube\cache\boot2docker.iso from file://C:/Users/sdixon/.minikube/cache/iso/minikube-v0.
23.5.iso...
Creating SSH key...
Creating VM...
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (Get-VMSwitch).Na
me
[stdout =====>] : Layered_Ethernet
Primary Virtual Switch
DockerNAT

[stderr =====>] :
Using switch "Primary Virtual Switch"
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive @([Security.Princ
ipal.WindowsPrincipal][Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole([Security.Principal.WindowsBuiltInRol
e] "Administrator")
[stdout =====>] : True

[stderr =====>] :
Creating VHD
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive New-VHD -Path 'C:
\Users\sdixon\.minikube\machines\minikube\fixed.vhd' -SizeBytes 10MB -Fixed
[stdout =====>] :

ComputerName            : DevBox
Path                    : C:\Users\sdixon\.minikube\machines\minikube\fixed.vhd
VhdFormat               : VHD
VhdType                 : Fixed
FileSize                : 10486272
Size                    : 10485760
MinimumSize             :
LogicalSectorSize       : 512
PhysicalSectorSize      : 512
BlockSize               : 0
ParentPath              :
DiskIdentifier          : 5E010A0E-F0AD-432F-9182-333D003E22F7
FragmentationPercentage : 0
Alignment               : 1
Attached                : False
DiskNumber              :
Number                  :

[stderr =====>] :
Writing magic tar header
Writing SSH key tar header
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Convert-VHD -Path
 'C:\Users\sdixon\.minikube\machines\minikube\fixed.vhd' -DestinationPath 'C:\Users\sdixon\.minikube\machines\minikube\d
isk.vhd' -VHDType Dynamic -DeleteSource
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Resize-VHD -Path
'C:\Users\sdixon\.minikube\machines\minikube\disk.vhd' -SizeBytes 20000MB
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive New-VM minikube -
Path 'C:\Users\sdixon\.minikube\machines\minikube' -SwitchName 'Primary Virtual Switch' -MemoryStartupBytes 2048MB
[stdout =====>] :
Name     State CPUUsage(%) MemoryAssigned(M) Uptime   Status             Version
----     ----- ----------- ----------------- ------   ------             -------
minikube Off   0           0                 00:00:00 Operating normally 8.0

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Set-VMProcessor m
inikube -Count 2
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Set-VMDvdDrive -V
MName minikube -Path 'C:\Users\sdixon\.minikube\machines\minikube\boot2docker.iso'
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Add-VMHardDiskDri
ve -VMName minikube -Path 'C:\Users\sdixon\.minikube\machines\minikube\disk.vhd'
[stdout =====>] :
[stderr =====>] :
Starting VM...
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive Start-VM minikube
[stdout =====>] :
[stderr =====>] :
Waiting for host to start...
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] :
[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
setting hostname "minikube"
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
SSH binary not found, using native Go implementation
&{{{<nil> 0 [] [] []} docker [0x853140] <nil>  [] 0s} fe80::215:5dff:fe00:414 22 <nil> <nil>}
About to run SSH command:
sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname
Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [publickey none], no supported
methods remain
SSH cmd err, output: <nil>: minikube

[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
SSH binary not found, using native Go implementation
&{{{<nil> 0 [] [] []} docker [0x853140] <nil>  [] 0s} fe80::215:5dff:fe00:414 22 <nil> <nil>}
About to run SSH command:

                if ! grep -xq '.*\sminikube' /etc/hosts; then
                        if grep -xq '127.0.1.1\s.*' /etc/hosts; then
                                sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts;
                        else
                                echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts;
                        fi
                fi
SSH cmd err, output: <nil>:
set auth options {CertDir:C:\Users\sdixon\.minikube CaCertPath:C:\Users\sdixon\.minikube\certs\ca.pem CaPrivateKeyPath:C
:\Users\sdixon\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\sdixon\.minikube\m
achines\server.pem ServerKeyPath:C:\Users\sdixon\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\sdixon\.miniku
be\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPa
th:C:\Users\sdixon\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\sdixon\.minikube}
setting up certificates
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
generating server cert: C:\Users\sdixon\.minikube\machines\server.pem ca-key=C:\Users\sdixon\.minikube\certs\ca.pem priv
ate-key=C:\Users\sdixon\.minikube\certs\ca-key.pem org=sdixon.minikube san=[fe80::215:5dff:fe00:414 localhost]
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
I1018 16:18:39.624895    4516 ssh_runner.go:57] Run: sudo rm -f /etc/docker/server.pem
I1018 16:18:39.672948    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/docker
I1018 16:18:39.690261    4516 ssh_runner.go:57] Run: sudo rm -f /etc/docker/server-key.pem
I1018 16:18:39.696196    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/docker
I1018 16:18:39.706893    4516 ssh_runner.go:57] Run: sudo rm -f /etc/docker/ca.pem
I1018 16:18:39.711922    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/docker
Setting Docker configuration on the remote daemon...
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
SSH binary not found, using native Go implementation
&{{{<nil> 0 [] [] []} docker [0x853140] <nil>  [] 0s} fe80::215:5dff:fe00:414 22 <nil> <nil>}
About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target docker.socket
Requires=docker.socket

[Service]
Type=notify

# DOCKER_RAMDISK disables pivot_root in Docker, using MS_MOVE instead.
Environment=DOCKER_RAMDISK=yes

# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
ExecStart=
ExecStart=/usr/bin/docker daemon -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --tlsverify --tlscacert /etc/docke
r/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperv --insecure-registr
y 10.0.0.0/24
ExecReload=/bin/kill -s HUP $MAINPID

# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity

# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0

# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes

# kill only the docker process, not all processes in the cgroup
KillMode=process

[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service
SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target docker.socket
Requires=docker.socket

[Service]
Type=notify

# DOCKER_RAMDISK disables pivot_root in Docker, using MS_MOVE instead.
Environment=DOCKER_RAMDISK=yes

# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
ExecStart=
ExecStart=/usr/bin/docker daemon -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --tlsverify --tlscacert /etc/docke
r/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperv --insecure-registr
y 10.0.0.0/24
ExecReload=/bin/kill -s HUP

# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity

# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0

# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes

# kill only the docker process, not all processes in the cgroup
KillMode=process

[Install]
WantedBy=multi-user.target

[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
SSH binary not found, using native Go implementation
&{{{<nil> 0 [] [] []} docker [0x853140] <nil>  [] 0s} fe80::215:5dff:fe00:414 22 <nil> <nil>}
About to run SSH command:
sudo systemctl daemon-reload
SSH cmd err, output: <nil>:
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
SSH binary not found, using native Go implementation
&{{{<nil> 0 [] [] []} docker [0x853140] <nil>  [] 0s} fe80::215:5dff:fe00:414 22 <nil> <nil>}
About to run SSH command:
sudo systemctl -f restart docker
SSH cmd err, output: <nil>:
Getting VM IP address...
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
Moving files into cluster...
I1018 16:18:49.279795    4516 cache_images.go:166] Loading image from cache at  C:\Users\sdixon\.minikube\cache\images\g
cr.io\google_containers\pause-amd64_3.0
I1018 16:18:49.280793    4516 ssh_runner.go:57] Run: sudo rm -f /tmp/pause-amd64_3.0
I1018 16:18:49.281793    4516 cache_images.go:166] Loading image from cache at  C:\Users\sdixon\.minikube\cache\images\g
cr.io\google_containers\kubernetes-dashboard-amd64_v1.6.3
I1018 16:18:49.283818    4516 cache_images.go:166] Loading image from cache at  C:\Users\sdixon\.minikube\cache\images\g
cr.io\google_containers\k8s-dns-kube-dns-amd64_1.14.4
I1018 16:18:49.290796    4516 cache_images.go:166] Loading image from cache at  C:\Users\sdixon\.minikube\cache\images\g
cr.io\google_containers\k8s-dns-dnsmasq-nanny-amd64_1.14.4
I1018 16:18:49.294795    4516 ssh_runner.go:57] Run: sudo rm -f /tmp/k8s-dns-kube-dns-amd64_1.14.4
I1018 16:18:49.295812    4516 cache_images.go:166] Loading image from cache at  C:\Users\sdixon\.minikube\cache\images\g
cr.io\google_containers\k8s-dns-sidecar-amd64_1.14.4
I1018 16:18:49.304792    4516 cache_images.go:166] Loading image from cache at  C:\Users\sdixon\.minikube\cache\images\g
cr.io\google-containers\kube-addon-manager_v6.4-beta.2
I1018 16:18:49.318796    4516 ssh_runner.go:57] Run: sudo rm -f /tmp/k8s-dns-dnsmasq-nanny-amd64_1.14.4
I1018 16:18:49.321815    4516 ssh_runner.go:57] Run: sudo rm -f /tmp/k8s-dns-sidecar-amd64_1.14.4
I1018 16:18:49.309793    4516 ssh_runner.go:57] Run: sudo rm -f /tmp/kubernetes-dashboard-amd64_v1.6.3
I1018 16:18:49.352797    4516 ssh_runner.go:57] Run: sudo rm -f /tmp/kube-addon-manager_v6.4-beta.2
I1018 16:18:49.369791    4516 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1018 16:18:49.387801    4516 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1018 16:18:49.389790    4516 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1018 16:18:49.391794    4516 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1018 16:18:49.391794    4516 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1018 16:18:49.396791    4516 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1018 16:18:49.591872    4516 ssh_runner.go:57] Run: docker load -i \tmp\pause-amd64_3.0
I1018 16:18:51.082830    4516 ssh_runner.go:57] Run: docker load -i \tmp\k8s-dns-kube-dns-amd64_1.14.4
I1018 16:18:51.387798    4516 ssh_runner.go:57] Run: docker load -i \tmp\k8s-dns-dnsmasq-nanny-amd64_1.14.4
I1018 16:18:51.396797    4516 ssh_runner.go:57] Run: docker load -i \tmp\k8s-dns-sidecar-amd64_1.14.4
I1018 16:18:51.424795    4516 ssh_runner.go:57] Run: sudo rm -f /usr/local/bin/localkube
I1018 16:18:51.430810    4516 ssh_runner.go:57] Run: docker load -i \tmp\kube-addon-manager_v6.4-beta.2
I1018 16:18:51.481232    4516 ssh_runner.go:57] Run: sudo mkdir -p /usr/local/bin
I1018 16:18:53.560790    4516 ssh_runner.go:57] Run: docker load -i \tmp\kubernetes-dashboard-amd64_v1.6.3
I1018 16:18:54.236791    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/manifests/addon-manager.yaml
I1018 16:18:54.244820    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/manifests/
I1018 16:18:54.256801    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/kube-dns-controller.yaml
I1018 16:18:54.264791    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1018 16:18:54.283799    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/kube-dns-cm.yaml
I1018 16:18:54.288801    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1018 16:18:54.312801    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/kube-dns-svc.yaml
I1018 16:18:54.318812    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1018 16:18:54.332795    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/dashboard-rc.yaml
I1018 16:18:54.338805    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1018 16:18:54.348797    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/dashboard-svc.yaml
I1018 16:18:54.355796    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1018 16:18:54.370803    4516 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/storageclass.yaml
I1018 16:18:54.375794    4516 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
Setting up certs...
I1018 16:18:54.386791    4516 certs.go:48] Setting up certificates for IP: fe80::215:5dff:fe00:414
I1018 16:18:54.484798    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/ca.crt
I1018 16:18:54.512792    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.529799    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/ca.key
I1018 16:18:54.535805    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.550800    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/apiserver.crt
I1018 16:18:54.556374    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.568791    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/apiserver.key
I1018 16:18:54.574796    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.590791    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client-ca.crt
I1018 16:18:54.596792    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.606797    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client-ca.key
I1018 16:18:54.615798    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.625796    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client.crt
I1018 16:18:54.631796    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.647793    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client.key
I1018 16:18:54.653790    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1018 16:18:54.664799    4516 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/kubeconfig
I1018 16:18:54.670793    4516 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube
Connecting to cluster...
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Get-VM minikube
 ).state
[stdout =====>] : Running

[stderr =====>] :
[executing ==>] : C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Get-VM minikub
e ).networkadapters[0]).ipaddresses[0]
[stdout =====>] : fe80::215:5dff:fe00:414

[stderr =====>] :
Setting up kubeconfig...
I1018 16:18:56.318799    4516 config.go:101] Using kubeconfig:  C:\Users\sdixon/.kube/config
Starting cluster components...
I1018 16:18:56.330794    4516 ssh_runner.go:57] Run: if [[ `systemctl` =~ -\.mount ]] &>/dev/null;then
  printf %s "[Unit]
Description=Localkube
Documentation=https://github.com/kubernetes/minikube/tree/master/pkg/localkube

[Service]
Type=notify
Restart=always
RestartSec=3

ExecStart=/usr/local/bin/localkube   --v 7 --dns-domain=cluster.local --node-ip=fe80::215:5dff:fe00:414 --generate-certs
=false --logtostderr=true --enable-dns=false

ExecReload=/bin/kill -s HUP $MAINPID

[Install]
WantedBy=multi-user.target
" | sudo tee /usr/lib/systemd/system/localkube.service
  sudo systemctl daemon-reload
  sudo systemctl enable localkube.service
  sudo systemctl restart localkube.service || true
else
  sudo killall localkube || true

# Run with nohup so it stays up. Redirect logs to useful places.
sudo sh -c 'PATH=/usr/local/sbin:$PATH nohup /usr/local/bin/localkube   --v 7 --dns-domain=cluster.local --node-ip=fe80:
:215:5dff:fe00:414 --generate-certs=false --logtostderr=true --enable-dns=false > /var/lib/localkube/localkube.out 2> /v
ar/lib/localkube/localkube.err < /dev/null & echo $! > /var/run/localkube.pid &'

fi

Kubectl is now configured to use the cluster.

Anything else do we need to know:

dlorenc commented 7 years ago

Looks like localkube is crashing in your VM. Could you attach the output of minikube logs as well?

sdixonbigdog commented 7 years ago

That folder appears to be empty...what do I need to do to get those logs to be produced?

sdixonbigdog commented 7 years ago

Oct 20 16:58:28 minikube localkube[8105]: I1020 16:58:28.963987 8105 interface.go:259] No valid IP found Oct 20 16:58:28 minikube localkube[8105]: apiserver: Exit with error: Unable to find suitable network address.error='Una ble to select an IP.'. Try to set the AdvertiseAddress directly or provide a valid BindAddress to fix this. Oct 20 16:58:29 minikube localkube[8105]: I1020 16:58:29.164369 8105 server.go:112] Version: v1.7.5 Oct 20 16:58:29 minikube localkube[8105]: F1020 16:58:29.164421 8105 plugins.go:72] Admission plugin "AlwaysAdmit" wa s registered twice Oct 20 16:58:29 minikube systemd[1]: localkube.service: Main process exited, code=exited, status=255/n/a Oct 20 16:58:29 minikube systemd[1]: Failed to start Localkube. Oct 20 16:58:29 minikube systemd[1]: localkube.service: Unit entered failed state. Oct 20 16:58:29 minikube systemd[1]: localkube.service: Failed with result 'exit-code'.

fejta-bot commented 6 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or @fejta. /lifecycle stale

fejta-bot commented 6 years ago

Stale issues rot after 30d of inactivity. Mark the issue as fresh with /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle rotten /remove-lifecycle stale

fejta-bot commented 6 years ago

Rotten issues close after 30d of inactivity. Reopen the issue with /reopen. Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /close