uli-fischer
commented
1 year ago tested with oguertlertt/flannel:v0.22.0. Same Problem. 👎 no clue what it's wrong.
$ kubectl get daemonsets -n kube-flannel -o=wide
NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE CONTAINERS IMAGES SELECTOR
kube-flannel-ds 3 3 3 3 3 <none> 14d kube-flannel docker.io/flannel/flannel:v0.22.0 app=flannel
kube-flannel-ds-windows-amd64 1 1 1 1 1 <none> 14d kube-flannel oguertlertt/flannel:v0.22.0-hostprocess app=flannelget this errors in the Logfile od the Hostprocess:
$ kubectl logs kube-flannel-ds-windows-amd64-bf4bc -n kube-flannel -f
Copying SDN CNI binaries to host
Directory: C:\opt\cni
Mode LastWriteTime Length Name
---- ------------- ------ ----
d----- 7/2/2023 3:25 PM bin
copy flannel config
Directory: C:\etc
Mode LastWriteTime Length Name
---- ------------- ------ ----
d----- 7/2/2023 4:38 PM kube-flannel
Directory: C:\etc\kube-flannel
Mode LastWriteTime Length Name
---- ------------- ------ ----
-a---- 8/5/2023 9:39 AM 109 net-conf.json
Directory: C:\hpc\mounts\kube-flannel
Mode LastWriteTime Length Name
---- ------------- ------ ----
d----- 8/5/2023 9:45 AM ..2023_08_05_16_45_21.1802066358
d----l 8/5/2023 9:45 AM ..data
-a---l 8/5/2023 9:45 AM 0 cni-conf.json
-a---l 8/5/2023 9:45 AM 0 net-conf.json
update cni config
Directory: C:\etc\cni
Mode LastWriteTime Length Name
---- ------------- ------ ----
d----- 7/2/2023 4:38 PM net.d
add route
The route addition failed: The object already exists.
envs
kube-flannel-ds-windows-amd64-bf4bc
kube-flannel
Starting flannel
I0805 09:45:24.184051 246316 main.go:212] CLI flags config: {etcdEndpoints:http://127.0.0.1:4001,http://127.0.0.1:2379 etcdPrefix:/coreos.com/network etcdKeyfile: etcdCertfile: etcdCAFile: etcdUsername: etcdPassword: version:false kubeSubnetMgr:true kubeApiUrl: kubeAnnotationPrefix:flannel.alpha.coreos.com kubeConfigFile: iface:[10.10.13.204] ifaceRegex:[] ipMasq:false ifaceCanReach: subnetFile:/run/flannel/subnet.env publicIP: publicIPv6: subnetLeaseRenewMargin:60 healthzIP:0.0.0.0 healthzPort:0 iptablesResyncSeconds:5 iptablesForwardRules:true netConfPath:/etc/kube-flannel/net-conf.json setNodeNetworkUnavailable:true useMultiClusterCidr:false}
W0805 09:45:24.186802 246316 client_config.go:617] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I0805 09:45:24.254216 246316 kube.go:486] Starting kube subnet manager
I0805 09:45:24.254216 246316 kube.go:145] Waiting 10m0s for node controller to sync
I0805 09:45:24.267665 246316 kube.go:507] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.244.0.0/24]
I0805 09:45:24.267665 246316 kube.go:507] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.244.1.0/24]
I0805 09:45:24.267665 246316 kube.go:507] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.244.2.0/24]
I0805 09:45:24.267665 246316 kube.go:507] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.244.4.0/24]
I0805 09:45:25.255069 246316 kube.go:152] Node controller sync successful
I0805 09:45:25.255069 246316 main.go:232] Created subnet manager: Kubernetes Subnet Manager - k8t-win-node-1
I0805 09:45:25.255069 246316 main.go:235] Installing signal handlers
I0805 09:45:25.255713 246316 main.go:543] Found network config - Backend type: vxlan
I0805 09:45:25.256988 246316 match.go:73] Searching for interface using 10.10.13.204
I0805 09:45:25.272671 246316 match.go:259] Using interface with name vEthernet (Ethernet) and address 10.10.13.204
I0805 09:45:25.275260 246316 match.go:281] Defaulting external address to interface address (10.10.13.204)
I0805 09:45:25.275327 246316 vxlan_windows.go:126] VXLAN config: Name=flannel.4096 MacPrefix=0E-2A VNI=4096 Port=4789 GBP=false DirectRouting=false
time="2023-08-05T09:45:25-07:00" level=info msg="HCN feature check" supportedFeatures="{Acl:{AclAddressLists:true AclNoHostRulePriority:true AclPortRanges:true AclRuleId:true} Api:{V1:true V2:true} RemoteSubnet:true HostRoute:true DSR:true Slash32EndpointPrefixes:true AclSupportForProtocol252:false SessionAffinity:false IPv6DualStack:false SetPolicy:false VxlanPort:false L4Proxy:true L4WfpProxy:false TierAcl:false NetworkACL:false NestedIpSet:false}" version="{Major:9 Minor:5}"
I0805 09:45:25.354942 246316 kube.go:507] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.244.4.0/24]
I0805 09:45:25.354994 246316 device_windows.go:103] Found existing HostComputeNetwork flannel.4096
I0805 09:45:25.381913 246316 main.go:408] Changing default FORWARD chain policy to ACCEPT
I0805 09:45:25.383161 246316 kube.go:507] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.244.4.0/24]
I0805 09:45:25.383739 246316 main.go:436] Wrote subnet file to /run/flannel/subnet.env
I0805 09:45:25.383739 246316 main.go:440] Running backend.
I0805 09:45:25.383739 246316 vxlan_network_windows.go:63] Watching for new subnet leases
I0805 09:45:25.383739 246316 subnet.go:159] Batch elem [0] is { lease.Event{Type:0, Lease:lease.Lease{EnableIPv4:true, EnableIPv6:false, Subnet:ip.IP4Net{IP:0xaf40000, PrefixLen:0x18}, IPv6Subnet:ip.IP6Net{IP:(*ip.IP6)(nil), PrefixLen:0x0}, Attrs:lease.LeaseAttrs{PublicIP:0xa0a0dc9, PublicIPv6:(*ip.IP6)(nil), BackendType:"vxlan", BackendData:json.RawMessage{0x7b, 0x22, 0x56, 0x4e, 0x49, 0x22, 0x3a, 0x34, 0x30, 0x39, 0x36, 0x2c, 0x22, 0x56, 0x74, 0x65, 0x70, 0x4d, 0x41, 0x43, 0x22, 0x3a, 0x22, 0x38, 0x32, 0x3a, 0x62, 0x66, 0x3a, 0x66, 0x32, 0x3a, 0x33, 0x65, 0x3a, 0x30, 0x65, 0x3a, 0x62, 0x33, 0x22, 0x7d}, BackendV6Data:json.RawMessage(nil)}, Expiration:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Asof:0}} }
I0805 09:45:25.383739 246316 subnet.go:159] Batch elem [0] is { lease.Event{Type:0, Lease:lease.Lease{EnableIPv4:true, EnableIPv6:false, Subnet:ip.IP4Net{IP:0xaf40100, PrefixLen:0x18}, IPv6Subnet:ip.IP6Net{IP:(*ip.IP6)(nil), PrefixLen:0x0}, Attrs:lease.LeaseAttrs{PublicIP:0xa0a0dca, PublicIPv6:(*ip.IP6)(nil), BackendType:"vxlan", BackendData:json.RawMessage{0x7b, 0x22, 0x56, 0x4e, 0x49, 0x22, 0x3a, 0x34, 0x30, 0x39, 0x36, 0x2c, 0x22, 0x56, 0x74, 0x65, 0x70, 0x4d, 0x41, 0x43, 0x22, 0x3a, 0x22, 0x64, 0x32, 0x3a, 0x30, 0x33, 0x3a, 0x35, 0x62, 0x3a, 0x34, 0x32, 0x3a, 0x32, 0x30, 0x3a, 0x33, 0x39, 0x22, 0x7d}, BackendV6Data:json.RawMessage(nil)}, Expiration:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Asof:0}} }
I0805 09:45:25.388437 246316 subnet.go:159] Batch elem [0] is { lease.Event{Type:0, Lease:lease.Lease{EnableIPv4:true, EnableIPv6:false, Subnet:ip.IP4Net{IP:0xaf40200, PrefixLen:0x18}, IPv6Subnet:ip.IP6Net{IP:(*ip.IP6)(nil), PrefixLen:0x0}, Attrs:lease.LeaseAttrs{PublicIP:0xa0a0dcb, PublicIPv6:(*ip.IP6)(nil), BackendType:"vxlan", BackendData:json.RawMessage{0x7b, 0x22, 0x56, 0x4e, 0x49, 0x22, 0x3a, 0x34, 0x30, 0x39, 0x36, 0x2c, 0x22, 0x56, 0x74, 0x65, 0x70, 0x4d, 0x41, 0x43, 0x22, 0x3a, 0x22, 0x38, 0x32, 0x3a, 0x61, 0x33, 0x3a, 0x35, 0x39, 0x3a, 0x36, 0x63, 0x3a, 0x63, 0x36, 0x3a, 0x62, 0x61, 0x22, 0x7d}, BackendV6Data:json.RawMessage(nil)}, Expiration:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Asof:0}} }
I0805 09:45:25.426776 246316 main.go:461] Waiting for all goroutines to exit
....
Mik4sa
iankingori
FangKee
Zombro
k8s-triage-robot
k8s-ci-robot
Describe the bug I've problem when installing a Windows node.
Is there a typo in the documentation? in the Guide for flannel guides/flannel.md was a refferenz to install flannel for WIndows:
It reffers to Version v0.21.5 but the newes version i could found is Version v0.14.0-hostprocess i changed it to mik4sa/flannel:v0.21.5 but not clear if this is correct. with this change the Proxy and Host Process is up. but unfortunately is fail in the next error no connection to Service LAN
when i Install the Node and start a pod (see config) i could ping alls Networks expected the Service LAN. so the DNS is not working.
To Reproduce Do on a running Cluster:
Uses this Testpod Config:
and make this Tests
Expected behavior PS C:> nslookup www.google.de should work.
Kubernetes (please complete the following information):
WindowsVersion
1809
PS C:> Get-ComputerInfo | Select-Object WindowsVersion
WindowsVersion
1809
$ kubectl version --output=yaml clientVersion: buildDate: "2023-06-14T09:53:42Z" compiler: gc gitCommit: 25b4e43193bcda6c7328a6d147b1fb73a33f1598 gitTreeState: clean gitVersion: v1.27.3 goVersion: go1.20.5 major: "1" minor: "27" platform: linux/arm64 kustomizeVersion: v5.0.1 serverVersion: buildDate: "2023-06-14T09:47:40Z" compiler: gc gitCommit: 25b4e43193bcda6c7328a6d147b1fb73a33f1598 gitTreeState: clean gitVersion: v1.27.3 goVersion: go1.20.5 major: "1" minor: "27" platform: linux/arm64
$ kubectl get daemonsets -n kube-flannel -o=wide NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE CONTAINERS IMAGES SELECTOR kube-flannel-ds 3 3 3 3 3 14d kube-flannel docker.io/flannel/flannel:v0.22.0 app=flannel
kube-flannel-ds-windows-amd64 1 1 1 1 1 14d kube-flannel mik4sa/flannel:v0.21.5-hostprocess app=flannel
$ kubectl logs kube-flannel-ds-windows-amd64-qtgvk -n kube-flannel Copying SDN CNI binaries to host
Mode LastWriteTime Length Name
d----- 7/2/2023 3:25 PM bin copy flannel config
Mode LastWriteTime Length Name
d----- 7/2/2023 4:38 PM kube-flannel
Mode LastWriteTime Length Name
-a---- 8/5/2023 9:16 AM 109 net-conf.json
Mode LastWriteTime Length Name
d----- 8/5/2023 9:16 AM ..2023_08_05_16_16_31.325047069 d----l 8/5/2023 9:16 AM ..data -a---l 8/5/2023 9:16 AM 0 cni-conf.json -a---l 8/5/2023 9:16 AM 0 net-conf.json update cni config get-content : Cannot find path 'C:\hpc\mounts\kubeadm-config\ClusterConfiguration' because it does not exist. At C:\hpc\flannel\start.ps1:18 char:18