Closed Sinless777 closed 2 years ago
Hi šš¼
.config.env
without secretstask cluster:resources
My config.env:
#
# Cluster related variables
#
########################################################################################################################
## WEBHOOK URL ##
## ##
## https://flux-reciever.sinlessgamesllc.com/hook/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX ##
## ##
########################################################################################################################
# The repo you created from this template
# e.g. https://github.com/k8s-at-home/home-cluster
export BOOTSTRAP_GIT_REPOSITORY="https://github.com/SinLess-Games/Cluster-1"
# Optional: Enable GitHub to send a webhook to update Flux, set the following to one of:
# ignored - this feature will be disabled
# generated - this will generate a token and print it in the logs
# Set this to any other string and it will be used for the secret
export BOOTSTRAP_FLUX_GITHUB_WEBHOOK_SECRET="SECRET"
# Choose one of your cloudflare domains
# e.g. k8s-at-home.com
export BOOTSTRAP_CLOUDFLARE_DOMAIN="sinlessgamesllc.com"
# The email you use to sign into Cloudflare with
export BOOTSTRAP_CLOUDFLARE_EMAIL="disdainful777@gmail.com"
# Your global Cloudflare API Key
export BOOTSTRAP_CLOUDFLARE_APIKEY="SECRET"
# Pick a range of unused IPs that are on the same network as your nodes
# You don't need many IPs, just choose 10 IPs to start with
# e.g. 192.168.1.220-192.168.1.230
export BOOTSTRAP_METALLB_LB_RANGE="192.XXX.XXX.150-192.XXX.XXX.250"
# The load balancer IP for k8s_gateway, choose from one of the available IPs above
# e.g. 192.168.1.220
export BOOTSTRAP_METALLB_K8S_GATEWAY_ADDR="192.XXX.XXX.150"
# The load balancer IP for traefik, choose from one of the available IPs above
# that doesn't conflict with any other IP addresses here
# e.g. 192.168.1.221
export BOOTSTRAP_METALLB_TRAEFIK_ADDR="192.XXX.XXX.151"
# Age Public Key - string should start with age
# e.g. age15uzrw396e67z9wdzsxzdk7ka0g2gr3l460e0slaea563zll3hdfqwqxdta
export BOOTSTRAP_AGE_PUBLIC_KEY="SECRET"
# The IP Address to use with KubeVIP
# Pick a unused IP that is on the same network as your nodes
# and outside the ${BOOTSTRAP_METALLB_LB_RANGE} range
# and doesn't conflict with any other IP addresses here
# e.g. 192.168.1.254
export BOOTSTRAP_KUBE_VIP_ADDR="192.168.86.40"
#
# Ansible related variables
#
#
# Default prefixes for hostnames assigned by Ansible
# These are unused on nodes where BOOTSTRAP_ANSIBLE_HOSTNAME_ is provided
#
export BOOTSTRAP_ANSIBLE_DEFAULT_CONTROL_NODE_HOSTNAME_PREFIX="k8s-"
export BOOTSTRAP_ANSIBLE_DEFAULT_NODE_HOSTNAME_PREFIX="k8s-"
#
# Ansible hosts - repeat this block as many times as you need,
# incrementing the last digit on the variable name for each node
#
# Host IP Address to the control plane node
# That doesn't conflict with any other IP addresses here
# e.g. 192.168.1.200
export BOOTSTRAP_ANSIBLE_HOST_ADDR_0="192.168.86.132"
# User Ansible will log into the nodes
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_0="sinless777"
# Password Ansible will use to escalate to sudo
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_0="Shells93"
# Set this node as a control node (true/false)
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_0="true"
# Optional: Set the hostname of the node, if set this will override the *_HOSTNAME_PREFIX vars above
export BOOTSTRAP_ANSIBLE_HOSTNAME_0=""
export BOOTSTRAP_ANSIBLE_HOST_ADDR_1="192.168.86.133"
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_1="sinless777"
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_1="Shells93"
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_1="true"
export BOOTSTRAP_ANSIBLE_HOSTNAME_1=""
export BOOTSTRAP_ANSIBLE_HOST_ADDR_2="192.168.86.134"
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_2="sinless777"
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_2="Shells93"
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_2="true"
export BOOTSTRAP_ANSIBLE_HOSTNAME_2=""
export BOOTSTRAP_ANSIBLE_HOST_ADDR_3="192.168.86.135"
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_3="sinless777"
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_3="Shells93"
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_3="false"
export BOOTSTRAP_ANSIBLE_HOSTNAME_3=""
export BOOTSTRAP_ANSIBLE_HOST_ADDR_4="192.168.86.136"
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_4="sinless777"
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_4="Shells93"
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_4="false"
export BOOTSTRAP_ANSIBLE_HOSTNAME_4=""
export BOOTSTRAP_ANSIBLE_HOST_ADDR_5="192.168.86.137"
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_5="sinless777"
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_5="Shells93"
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_5="false"
export BOOTSTRAP_ANSIBLE_HOSTNAME_5=""
export BOOTSTRAP_ANSIBLE_HOST_ADDR_6="192.168.86.138"
export BOOTSTRAP_ANSIBLE_SSH_USERNAME_6="sinless777"
export BOOTSTRAP_ANSIBLE_SUDO_PASSWORD_6="Shells93"
export BOOTSTRAP_ANSIBLE_CONTROL_NODE_6="false"
export BOOTSTRAP_ANSIBLE_HOSTNAME_6=""
$ task cluster:resources
task: [cluster:nodes] kubectl get nodes -o wide
NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
k8s-0 Ready control-plane,etcd,master 41h v1.23.6+k3s1 192.168.86.132 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
k8s-1 Ready control-plane,etcd,master 41h v1.23.6+k3s1 192.168.86.133 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
k8s-2 Ready control-plane,etcd,master 41h v1.23.6+k3s1 192.168.86.134 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
k8s-3 Ready <none> 41h v1.23.6+k3s1 192.168.86.135 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
k8s-4 Ready <none> 41h v1.23.6+k3s1 192.168.86.136 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
k8s-5 Ready <none> 41h v1.23.6+k3s1 192.168.86.137 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
k8s-6 Ready <none> 41h v1.23.6+k3s1 192.168.86.138 <none> Ubuntu 22.04 LTS 5.15.0-37-generic containerd://1.5.11-k3s2
task: [cluster:kustomizations] kubectl get kustomizations -A
NAMESPACE NAME AGE READY STATUS
flux-system apps 23h False kustomize build failed: accumulating resources: accumulation err='accumulating resources from 'backup-system': read /tmp/kustomization-4230188404/cluster/apps/backup-system: is a directory': recursed accumulation of path '/tmp/kustomization-4230188404/cluster/apps/backup-system': accumulating resources: accumulation err='accumulating resources from 'benji': read /tmp/kustomization-4230188404/cluster/apps/backup-system/benji: is a directory': couldn't make target for path '/tmp/kustomization-4230188404/cluster/apps/backup-system/benji': json: unknown field "files"
flux-system core 23h True Applied revision: main/5014fba860efc4979f27dba13e219b2eb4670c98
flux-system crds 23h True Applied revision: main/5014fba860efc4979f27dba13e219b2eb4670c98
flux-system flux-system 23h True Applied revision: main/5014fba860efc4979f27dba13e219b2eb4670c98
flux-system traefik-crds 23h True Applied revision: v10.20.1/1d0cf0e611d529615b322e10c30476d42a54a8c7
task: [cluster:helmreleases] kubectl get helmreleases -A
NAMESPACE NAME AGE READY STATUS
cert-manager cert-manager 23h True Release reconciliation succeeded
default echo-server 23h True Release reconciliation succeeded
default hajimari 23h True Release reconciliation succeeded
kube-system metrics-server 23h True Release reconciliation succeeded
kube-system reflector 23h True Release reconciliation succeeded
kube-system reloader 23h True Release reconciliation succeeded
metallb-system metallb 23h True Release reconciliation succeeded
networking error-pages 23h True Release reconciliation succeeded
networking external-dns 23h True Release reconciliation succeeded
networking k8s-gateway 23h True Release reconciliation succeeded
networking traefik 23h True Release reconciliation succeeded
task: [cluster:helmrepositories] kubectl get helmrepositories -A
NAMESPACE NAME URL AGE READY STATUS
flux-system authentik-charts https://charts.goauthentik.io/ 23h True stored artifact for revision '743cd71eabbec0b576b0a50ee50a69f3bb1747657bac5f404f470a719d933c79'
flux-system bitnami-charts https://charts.bitnami.com/bitnami 23h True stored artifact for revision '8875f0a7f5caeec8930b2d1ba2a03ed97d53af0f2a4dabe4287104ba3852d072'
flux-system deliveryhero-charts https://charts.deliveryhero.io/ 23h True stored artifact for revision '0da25d0ad6cc09c472c3c4d1b2812c72ac891fee8eaf9ece05c08ecebdf26876'
flux-system descheduler-charts https://kubernetes-sigs.github.io/descheduler 23h True stored artifact for revision 'dcfac9282d4ea8c4372f951e5e82ee69dbd487a3f8f3765c6fc50996225e5af8'
flux-system ealenn-charts https://ealenn.github.io/charts 23h True stored artifact for revision 'c15c222374b515204f87118928dbcc37aedda4873c023aafa67c8ae3d14a7b35'
flux-system emberstack-charts https://emberstack.github.io/helm-charts/ 23h True stored artifact for revision 'a114c924b5578774a8bbbdc14fb6b1fdb5232b557504f29f110128093913120a'
flux-system external-dns-charts https://kubernetes-sigs.github.io/external-dns 23h True stored artifact for revision '49b5667b530bebb9d0d3b60551f3a2841432d78d8a8580d8dc18aaf2d96c8cc4'
flux-system grafana-charts https://grafana.github.io/helm-charts 23h True stored artifact for revision '88329e8925ba262c3cd3e13cebd72e62f64594e4fd031f6998aa795e161de4cf'
flux-system hajimari-charts https://hajimari.io 23h True stored artifact for revision '7f5006d4671574a14b1ac37e1fc0ac4648a0e1d6e1c9eae5d0ee689293a49dae'
flux-system infracloudio-charts https://infracloudio.github.io/charts 23h True stored artifact for revision '2505ee57fb78c417178b072e1a0d7c3de133ce59877ea951bd315629c67a247e'
flux-system jetstack-charts https://charts.jetstack.io/ 23h True stored artifact for revision '1bc828f6413a2098626aa359ad624f1d2470a47e360a066a0d6f33cb8683c141'
flux-system k8s-at-home-charts https://k8s-at-home.com/charts/ 23h True stored artifact for revision '78d45a505f267d26e6b2ee4b59d1c2f0e3d04d0836077d6f5e8e02d61ce59804'
flux-system k8s-gateway https://ori-edge.github.io/k8s_gateway/ 23h True stored artifact for revision 'b92dab14277d4f89aef5fd2a05c08c799a49a45f2275407540ea42b6f609eace'
flux-system metallb-charts https://metallb.github.io/metallb 23h True stored artifact for revision '5e88db607455bb538a28b78fd5ca4e3e99e01712b4e5d28c37666ad0771066bb'
flux-system metrics-server-charts https://kubernetes-sigs.github.io/metrics-server 23h True stored artifact for revision '0ec994eb79350bd42668f31c26d9ca1605a892a9b1e3d9b9286218c0ce4ea541'
flux-system minecraft-server-charts https://itzg.github.io/minecraft-server-charts/ 23h True stored artifact for revision '748079f5e74d72151b10ec2abbcc5b328ae51c08c3004c7999b39b7b33506c98'
flux-system minio-charts https://operator.min.io 23h True stored artifact for revision '28656b2a03f14396dcfde65299d47bec5dc3a82b9efa7067fc3f9f47417fb435'
flux-system nfs-subdir-external-provisioner-charts https://kubernetes-sigs.github.io/nfs-subdir-external-provisioner/ 23h True stored artifact for revision 'c6ca25118585c78c1a75ae48e463d6d9b65791e5f6655dee10a224edd8ebe8b6'
flux-system node-feature-discovery-charts https://kubernetes-sigs.github.io/node-feature-discovery/charts 23h True stored artifact for revision '9caf935b309e3048567a52a883bf2d180fead586cc1eeac99802ce3a978c925e'
flux-system prometheus-community-charts https://prometheus-community.github.io/helm-charts 23h True stored artifact for revision '0986670f8219455a0f8ee5421d71d3280f077be3b42a76bbb943c1adfc37685e'
flux-system rook-ceph-charts https://charts.rook.io/release 23h True stored artifact for revision '1c1103fd548599d927310409e0225bc73862df7af4f155990388d8c12556eb48'
flux-system stakater-charts https://stakater.github.io/stakater-charts 23h True stored artifact for revision 'b628fd6e6da60cb4ad919290c7ae37dda5b8d5db9c853fbf9fc9f9fa352888f9'
flux-system traefik-charts https://helm.traefik.io/traefik 23h True stored artifact for revision 'e13365f2416882ff3b68706f6f1d615ee2e2f6ea2964f7a5067dbad249f1dfbf'
flux-system weaveworks-kured-charts https://weaveworks.github.io/kured 23h True stored artifact for revision 'ae28d9c90e2bb42b431414bd9eb26d3d8ea2b605dbb85708deded85e44cf9e83'
task: [cluster:gitrepositories] kubectl get gitrepositories -A
NAMESPACE NAME URL AGE READY STATUS
flux-system flux-system https://github.com/SinLess-Games/Cluster-1 23h True stored artifact for revision 'main/5014fba860efc4979f27dba13e219b2eb4670c98'
flux-system traefik-crd-source https://github.com/traefik/traefik-helm-chart.git 23h True stored artifact for revision 'v10.20.1/1d0cf0e611d529615b322e10c30476d42a54a8c7'
task: [cluster:certificates] kubectl get certificates -A
NAMESPACE NAME READY SECRET AGE
default echo-server-tls True echo-server-tls 23h
default hajimari-tls True hajimari-tls 23h
flux-system flux-receiver-tls True flux-receiver-tls 23h
networking traefik-dashboard-tls True traefik-dashboard-tls 23h
task: [cluster:certificates] kubectl get certificaterequests -A
NAMESPACE NAME APPROVED DENIED READY ISSUER REQUESTOR AGE
default echo-server-tls-9wptp True True letsencrypt-staging system:serviceaccount:cert-manager:cert-manager 23h
default hajimari-tls-9kxx2 True True letsencrypt-staging system:serviceaccount:cert-manager:cert-manager 23h
flux-system flux-receiver-tls-9nkpm True True letsencrypt-staging system:serviceaccount:cert-manager:cert-manager 23h
networking traefik-dashboard-tls-82jz7 True True letsencrypt-staging system:serviceaccount:cert-manager:cert-manager 23h
task: [cluster:pods] kubectl get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
calico-system calico-kube-controllers-6cdb6dcb5c-6hnfx 1/1 Running 0 41h
calico-system calico-node-dgrrg 1/1 Running 0 41h
calico-system calico-node-lwxjh 1/1 Running 0 41h
calico-system calico-node-m6dz4 1/1 Running 0 41h
calico-system calico-node-m7kdk 1/1 Running 0 41h
calico-system calico-node-pv9t8 1/1 Running 0 41h
calico-system calico-node-qzpxs 1/1 Running 0 41h
calico-system calico-node-rrvh2 1/1 Running 0 41h
calico-system calico-typha-778488dd84-7s8mj 1/1 Running 0 41h
calico-system calico-typha-778488dd84-fmhg8 1/1 Running 0 41h
calico-system calico-typha-778488dd84-l5xmb 1/1 Running 0 41h
cert-manager cert-manager-7555479cb4-vqkpp 1/1 Running 0 23h
cert-manager cert-manager-cainjector-5c55bb7cb4-mhjrb 1/1 Running 0 23h
cert-manager cert-manager-webhook-556f979d7f-fw295 1/1 Running 0 23h
default echo-server-54c54b475f-vshg4 1/1 Running 0 23h
default echo-server-54c54b475f-wvpvd 1/1 Running 0 23h
default hajimari-856499fdc9-rwgsj 1/1 Running 0 23h
flux-system helm-controller-7cdc7874f8-5z8gs 1/1 Running 0 20h
flux-system kustomize-controller-88567bd88-467ff 1/1 Running 0 20h
flux-system notification-controller-57cd4f4df-h84vq 1/1 Running 0 20h
flux-system source-controller-57cf5b9885-cbccj 1/1 Running 0 20h
kube-system coredns-d76bd69b-nj4p5 1/1 Running 0 41h
kube-system kube-vip-9pz9h 1/1 Running 0 41h
kube-system kube-vip-j96xl 1/1 Running 1 (41h ago) 41h
kube-system kube-vip-pkk9j 1/1 Running 1 (41h ago) 41h
kube-system local-path-provisioner-6c79684f77-fxbvf 1/1 Running 0 41h
kube-system metrics-server-7595bf4cb5-v78kn 1/1 Running 0 23h
kube-system reflector-5cf97cb7bc-wj77f 1/1 Running 0 23h
kube-system reloader-95856764f-9k4sz 1/1 Running 0 23h
metallb-system metallb-controller-777cbcf64f-64gc5 1/1 Running 0 23h
metallb-system metallb-speaker-5gpxg 1/1 Running 0 23h
metallb-system metallb-speaker-6tq89 1/1 Running 0 23h
metallb-system metallb-speaker-btjtn 1/1 Running 0 23h
metallb-system metallb-speaker-fl6rv 1/1 Running 0 23h
metallb-system metallb-speaker-hdf87 1/1 Running 0 23h
metallb-system metallb-speaker-j97nc 1/1 Running 0 23h
metallb-system metallb-speaker-kqb6w 1/1 Running 0 23h
networking error-pages-7bbf45dbd6-z8rqh 1/1 Running 0 23h
networking external-dns-67cc644f5b-kt5g9 1/1 Running 0 23h
networking k8s-gateway-5bfdcd6975-7z95m 1/1 Running 0 23h
networking traefik-75f8874b6d-fxwgd 1/1 Running 0 23h
tigera-operator tigera-operator-5dfdb4d87-pkbv8 1/1 Running 4 (23h ago) 41h
sinless777@Sinless-Games-Desktop:~/Desktop/Cluster-1$
Hey sorry I've been busy.
It does look like your Flux Kustomization for apps is errored.
kustomize build failed: accumulating resources: accumulation err='accumulating resources from 'backup-system': read /tmp/kustomization-4230188404/cluster/apps/backup-system: is a directory': recursed accumulation of path '/tmp/kustomization-4230188404/cluster/apps/backup-system': accumulating resources: accumulation err='accumulating resources from 'benji': read /tmp/kustomization-4230188404/cluster/apps/backup-system/benji: is a directory': couldn't make target for path '/tmp/kustomization-4230188404/cluster/apps/backup-system/benji': json: unknown field "files"
Maybe try to fix this issue first.
would you be able to walk me through how to properly add apps to this?
Take a look at the apps that come installed, that's a pretty good start to review. I would suggest joining our discord if you want specific help on anything.
I noticed alot of references to ${SECRET_DOMAIN} Where is that set, or do i need to set that?
That is set in the cluster-secrets.sops.yaml file.
My last question hopefully, now for some reason i got to this point:
~/Desktop/Cluster-1$ task cluster:helmreleases
task: [cluster:helmreleases] kubectl get helmreleases -A
NAMESPACE NAME AGE READY STATUS
cert-manager cert-manager 4d True Release reconciliation succeeded
default echo-server 4d True Release reconciliation succeeded
default hajimari 4d True Release reconciliation succeeded
downloads lidarr 118m False install retries exhausted
downloads overseerr 118m False install retries exhausted
downloads prowlarr 118m False install retries exhausted
downloads qbittorrent 118m False install retries exhausted
downloads radarr 118m False install retries exhausted
downloads sabnzbd 118m False install retries exhausted
downloads sonarr 118m False install retries exhausted
falco-system falco 118m False HelmChart 'flux-system/falco-system-falco' is not ready
falco-system falco-exporter 118m False HelmChart 'flux-system/falco-system-falco-exporter' is not ready
kube-system metrics-server 4d True Release reconciliation succeeded
kube-system reflector 4d True Release reconciliation succeeded
kube-system reloader 4d True Release reconciliation succeeded
media airsonic 118m False install retries exhausted
media calibre-web 118m False install retries exhausted
media calibre-web-fic 118m False install retries exhausted
media jellyfin 118m False install retries exhausted
media owncast 118m False install retries exhausted
media plex 118m False install retries exhausted
media szurubooru 118m False HelmChart 'flux-system/media-szurubooru' is not ready
media tautulli 118m False install retries exhausted
metallb-system metallb 4d True Release reconciliation succeeded
monitoring botkube 118m False install retries exhausted
monitoring speedtest-exporter 118m True Release reconciliation succeeded
networking error-pages 4d True Release reconciliation succeeded
networking external-dns 4d True Release reconciliation succeeded
networking k8s-gateway 4d True Release reconciliation succeeded
networking traefik 4d True Release reconciliation succeeded
security vaultwarden 118m False install retries exhausted
Is there a way to fix this? or do I just need to add 1 app at a time?
Add an app, make sure it works, rinse repeat. You are going to have a bad time just trying to do a bunch of things at once without validating along the way.
ok I will give it a shot.
Details
Ask your question:
So i am trying to add new apps into my cluster, and set up webhooks for flux, my web hook gets
http 523
. and will not communicate, i know my secret and url is correct. To top that off i do not believe my DNS is working properly(such is DNS after all.). My router is a ubiquiti security gateway pro, which i have forwarded port 443 and 80 to my traefik ip. I randig 192.168.86.150 hajimari.sinlessgamesllc.com
with this as a response:though i am uncertain as to how to make this all work properly. Any help would be greatly appreciated.