search

argoproj / argo-cd

Declarative Continuous Deployment for Kubernetes
https://argo-cd.readthedocs.io
Apache License 2.0
17.43k stars 5.3k forks source link

ArgoCD Application Sync stuck forever waiting for PreSync jobs to complete #4979

Open aindeev opened 3 years ago

aindeev commented 3 years ago

If you are trying to resolve an environment-specific issue or have a one-off question about the edge case that does not require a feature then please consider asking a question in argocd slack channel.

Checklist:

Describe the bug

ArgoCD Application deployment is stuck in an infinite loop of executing pre sync hooks. The hooks all have the following configuration:

apiVersion: batch/v1
kind: Job
metadata:
  generateName: XXXX-
  annotations:
    argocd.argoproj.io/hook: PreSync
    argocd.argoproj.io/hook-delete-policy: HookSucceeded
spec:
  backoffLimit: 2
  activeDeadlineSeconds: 120
  template:
    spec:
      restartPolicy: OnFailure
      containers:
        - name: job
          image: XXXX
          command:
            - XXXX

Also note that sometimes ArgoCD starts to think that it is waiting for 57 more hooks (or other large number) This is not accurate because we only have 6 pre-sync hooks in total in this helm chart. This message shows up in the ArgoCD UI.

The only way to solve the problem is to "Terminate" the sync and restart. Then the second sync always succeeds.

To Reproduce

Unclear. This happens in our environment once every few days sporadically.

Expected behavior

Sync should succeed or fail, but it should not be stuck.

Screenshots

Notable things in attached screenshots:

Screen Shot 2020-12-04 at 7 13 45 PM Screen Shot 2020-12-04 at 7 09 34 PM Screen Shot 2020-12-04 at 7 09 23 PM

Version

argocd: v1.7.8+ef5010c
  BuildDate: 2020-10-15T22:35:17Z
  GitCommit: ef5010c3a0b5e027fd642732d03c5b0391b1e574
  GitTreeState: clean
  GoVersion: go1.14.1
  Compiler: gc
  Platform: darwin/amd64
argocd-server: v1.7.6+b04c25e
  BuildDate: 2020-09-19T00:52:04Z
  GitCommit: b04c25eca8f1660359e325acd4be5338719e59a0
  GitTreeState: clean
  GoVersion: go1.14.1
  Compiler: gc
  Platform: linux/amd64
  Ksonnet Version: v0.13.1
  Kustomize Version: {Version:kustomize/v3.6.1 GitCommit:c97fa946d576eb6ed559f17f2ac43b3b5a8d5dbd BuildDate:2020-05-27T20:47:35Z GoOs:linux GoArch:amd64}
  Helm Version: version.BuildInfo{Version:"v3.2.0", GitCommit:"e11b7ce3b12db2941e90399e874513fbd24bcb71", GitTreeState:"clean", GoVersion:"go1.13.10"}
  Kubectl Version: v1.17.8

Logs

Added some logs from application controller ``` [ "time=\"2020-12-05T02:30:18Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:21Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:21Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:21Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:21Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:21Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:21Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:24Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:24Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=109 fields.level=1 git_ms=15 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=205\n", "time=\"2020-12-05T02:30:27Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:28Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:28Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:29Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:29Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:33Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:33Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:34Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:34Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:36Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:37Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:38Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:38Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:39Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:39Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:39Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:39Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:42Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:42Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:42Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:42Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:42Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:42Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:45Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/realize-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=realize-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02806-FegnV\n", "time=\"2020-12-05T02:30:45Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/custom-schema-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=custom-schema-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02806-FegnV\n", "time=\"2020-12-05T02:30:45Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/geography-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=geography-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02806-FegnV\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-post-migrate-rollback-e9aa074-presync--62135596800 created'\" application=shared1-main-chart-app kind=Job name=api-post-migrate-rollback-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02806-FegnV\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-pree9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=api-pree9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02806-FegnV\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/engage-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=engage-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02806-FegnV\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=6 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=146 fields.level=1 git_ms=27 health_ms=37 live_ms=7 settings_ms=0 sync_ms=0 time_ms=360\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02808-RSkuR\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02808-RSkuR tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:46Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:47Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=361 fields.level=1 git_ms=19 health_ms=79 live_ms=3 settings_ms=0 sync_ms=0 time_ms=611\n", "time=\"2020-12-05T02:30:48Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=57\n", "time=\"2020-12-05T02:30:49Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=36\n", "time=\"2020-12-05T02:30:49Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:49Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=104 fields.level=1 git_ms=11 health_ms=25 live_ms=1 settings_ms=0 sync_ms=0 time_ms=233\n", "time=\"2020-12-05T02:30:50Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:52Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:30:56Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:56Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=123 fields.level=1 git_ms=13 health_ms=39 live_ms=4 settings_ms=0 sync_ms=0 time_ms=271\n", "time=\"2020-12-05T02:30:56Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:57Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=112 fields.level=1 git_ms=13 health_ms=156 live_ms=2 settings_ms=0 sync_ms=0 time_ms=341\n", "time=\"2020-12-05T02:30:57Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:30:57Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=113 fields.level=1 git_ms=16 health_ms=92 live_ms=8 settings_ms=0 sync_ms=0 time_ms=295\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:01Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:07Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:13Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:19Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:23Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:24Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:24Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:27Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:27Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:28Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:31:28Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=127 fields.level=1 git_ms=15 health_ms=34 live_ms=4 settings_ms=0 sync_ms=0 time_ms=250\n", "time=\"2020-12-05T02:31:28Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:31:28Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=127 fields.level=1 git_ms=14 health_ms=27 live_ms=2 settings_ms=0 sync_ms=0 time_ms=220\n", "time=\"2020-12-05T02:31:28Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:29Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:31:29Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:30Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=225 fields.level=2 git_ms=281 health_ms=27 live_ms=4 settings_ms=0 sync_ms=0 time_ms=664\n", "time=\"2020-12-05T02:31:30Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:30Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:32Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:33Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:34Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:34Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:36Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:36Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:36Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:36Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:38Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:31:38Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=2 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=127 fields.level=1 git_ms=26 health_ms=38 live_ms=3 settings_ms=0 sync_ms=0 time_ms=639\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02810-QZFhr\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02810-QZFhr tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=35\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=37\n", "time=\"2020-12-05T02:31:39Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:31:40Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=140 fields.level=1 git_ms=20 health_ms=28 live_ms=2 settings_ms=0 sync_ms=0 time_ms=304\n", "time=\"2020-12-05T02:31:43Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:46Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:57Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:31:59Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:00Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=100 fields.level=1 git_ms=13 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=190\n", "time=\"2020-12-05T02:32:00Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:00Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=229 fields.level=1 git_ms=15 health_ms=26 live_ms=2 settings_ms=0 sync_ms=0 time_ms=324\n", "time=\"2020-12-05T02:32:00Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:00Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=99 fields.level=1 git_ms=11 health_ms=26 live_ms=2 settings_ms=0 sync_ms=0 time_ms=183\n", "time=\"2020-12-05T02:32:03Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:09Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:12Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:15Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:15Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:15Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:15Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:15Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:15Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:18Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:20Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:20Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:23Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:23Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:24Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:25Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:26Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:26Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:28Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:29Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:30Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:30Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:31Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:31Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=112 fields.level=1 git_ms=15 health_ms=27 live_ms=2 settings_ms=0 sync_ms=0 time_ms=206\n", "time=\"2020-12-05T02:32:32Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:32Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:32Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:32Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:32Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:32Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=241 fields.level=1 git_ms=16 health_ms=26 live_ms=6 settings_ms=0 sync_ms=0 time_ms=339\n", "time=\"2020-12-05T02:32:34Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:34Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:34Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:34Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:34Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:34Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/realize-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=realize-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02810-QZFhr\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-post-migrate-rollback-e9aa074-presync--62135596800 created'\" application=shared1-main-chart-app kind=Job name=api-post-migrate-rollback-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02810-QZFhr\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-pree9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=api-pree9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02810-QZFhr\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/engage-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=engage-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02810-QZFhr\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=111 fields.level=1 git_ms=67 health_ms=26 live_ms=4 settings_ms=0 sync_ms=0 time_ms=319\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/custom-schema-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=custom-schema-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02810-QZFhr\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/geography-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=geography-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02810-QZFhr\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02812-mWGiN\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=133 fields.level=1 git_ms=20 health_ms=32 live_ms=3 settings_ms=0 sync_ms=0 time_ms=321\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02812-mWGiN tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:38Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:40Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=31\n", "time=\"2020-12-05T02:32:41Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=34\n", "time=\"2020-12-05T02:32:41Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:32:41Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=115 fields.level=1 git_ms=16 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=248\n", "time=\"2020-12-05T02:32:43Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:46Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:56Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:32:57Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:33:02Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=97 fields.level=1 git_ms=13 health_ms=26 live_ms=2 settings_ms=0 sync_ms=0 time_ms=190\n", "time=\"2020-12-05T02:33:07Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:10Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:11Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:12Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:12Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:12Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:12Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:12Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:12Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:16Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:18Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:18Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:20Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:20Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:21Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:22Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:23Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:23Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:25Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:26Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:27Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:27Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:28Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:28Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:28Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:28Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02814-caAQW\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=133 fields.level=1 git_ms=11 health_ms=25 live_ms=1 settings_ms=0 sync_ms=0 time_ms=336\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02814-caAQW tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=128 fields.level=1 git_ms=15 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=217\n", "time=\"2020-12-05T02:33:32Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:33:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=104 fields.level=1 git_ms=10 health_ms=28 live_ms=2 settings_ms=0 sync_ms=0 time_ms=463\n", "time=\"2020-12-05T02:33:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=61\n", "time=\"2020-12-05T02:33:33Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:33:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=142 fields.level=1 git_ms=16 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=270\n", "time=\"2020-12-05T02:33:38Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:39Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:48Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:33:55Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:00Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:02Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=115 fields.level=1 git_ms=12 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=207\n", "time=\"2020-12-05T02:34:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:03Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=113 fields.level=1 git_ms=14 health_ms=39 live_ms=3 settings_ms=0 sync_ms=0 time_ms=229\n", "time=\"2020-12-05T02:34:03Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:03Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=93 fields.level=1 git_ms=11 health_ms=21 live_ms=2 settings_ms=0 sync_ms=0 time_ms=183\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:06Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:10Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:11Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:11Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:14Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:14Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:16Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:17Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:18Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:18Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:20Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:20Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:22Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:22Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:23Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:23Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:23Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:23Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:26Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:26Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:26Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:26Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:26Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:26Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:29Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/custom-schema-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=custom-schema-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02814-caAQW\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-pree9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=api-pree9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02814-caAQW\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/realize-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=realize-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02814-caAQW\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/engage-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=engage-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02814-caAQW\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-post-migrate-rollback-e9aa074-presync--62135596800 created'\" application=shared1-main-chart-app kind=Job name=api-post-migrate-rollback-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02814-caAQW\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/geography-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=geography-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02814-caAQW\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=283 fields.level=2 git_ms=239 health_ms=117 live_ms=30 settings_ms=0 sync_ms=1 time_ms=1033\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02816-KjagI\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=180 fields.level=1 git_ms=12 health_ms=34 live_ms=2 settings_ms=0 sync_ms=0 time_ms=332\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02816-KjagI tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:30Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:32Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=29\n", "time=\"2020-12-05T02:34:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=32\n", "time=\"2020-12-05T02:34:33Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=152 fields.level=1 git_ms=21 health_ms=35 live_ms=3 settings_ms=0 sync_ms=0 time_ms=330\n", "time=\"2020-12-05T02:34:34Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:34Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=104 fields.level=1 git_ms=11 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=340\n", "time=\"2020-12-05T02:34:34Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:37Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:44Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:51Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:51Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=122 fields.level=1 git_ms=13 health_ms=30 live_ms=11 settings_ms=0 sync_ms=0 time_ms=226\n", "time=\"2020-12-05T02:34:51Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:34:51Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=118 fields.level=1 git_ms=15 health_ms=25 live_ms=3 settings_ms=0 sync_ms=0 time_ms=211\n", "time=\"2020-12-05T02:34:54Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:34:56Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:02Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:06Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:07Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:07Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:09Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:09Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:11Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:12Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:13Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:13Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:15Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:16Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:17Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:17Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:19Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:19Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:19Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:19Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:21Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:21Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=160 fields.level=1 git_ms=13 health_ms=49 live_ms=2 settings_ms=0 sync_ms=1 time_ms=373\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02818-SDZfs\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02818-SDZfs tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:22Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=106 fields.level=1 git_ms=13 health_ms=27 live_ms=2 settings_ms=0 sync_ms=0 time_ms=199\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=29\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=30\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=112 fields.level=1 git_ms=18 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=266\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=94 fields.level=1 git_ms=13 health_ms=22 live_ms=3 settings_ms=0 sync_ms=0 time_ms=179\n", "time=\"2020-12-05T02:35:26Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:28Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:40Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:47Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:53Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:54Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:54Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=101 fields.level=1 git_ms=12 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=184\n", "time=\"2020-12-05T02:35:54Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:54Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:35:55Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=140 fields.level=1 git_ms=21 health_ms=28 live_ms=3 settings_ms=0 sync_ms=0 time_ms=240\n", "time=\"2020-12-05T02:35:59Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:59Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:59Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:59Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:59Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:35:59Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:02Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:03Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:03Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:05Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:05Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:08Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:09Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:10Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:10Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:12Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:12Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:13Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:13Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:15Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:15Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:15Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:15Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:18Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:18Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:18Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:18Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:18Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:18Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/custom-schema-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=custom-schema-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02818-SDZfs\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/geography-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=geography-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02818-SDZfs\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/engage-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=engage-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02818-SDZfs\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-post-migrate-rollback-e9aa074-presync--62135596800 created'\" application=shared1-main-chart-app kind=Job name=api-post-migrate-rollback-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02818-SDZfs\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-pree9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=api-pree9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02818-SDZfs\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=106 fields.level=1 git_ms=18 health_ms=26 live_ms=2 settings_ms=0 sync_ms=0 time_ms=280\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/realize-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=realize-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02818-SDZfs\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:21Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=232 fields.level=1 git_ms=16 health_ms=46 live_ms=5 settings_ms=0 sync_ms=1 time_ms=351\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02820-IaDYt\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02820-IaDYt tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:22Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=35\n", "time=\"2020-12-05T02:36:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=31\n", "time=\"2020-12-05T02:36:23Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:24Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=104 fields.level=1 git_ms=12 health_ms=28 live_ms=2 settings_ms=0 sync_ms=0 time_ms=262\n", "time=\"2020-12-05T02:36:26Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:26Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:26Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=289 fields.level=1 git_ms=35 health_ms=70 live_ms=3 settings_ms=0 sync_ms=0 time_ms=462\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:27Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:37Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:43Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:46Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:49Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:55Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:55Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:55Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:55Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:55Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:55Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:36:57Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:58Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=325 fields.level=1 git_ms=15 health_ms=29 live_ms=9 settings_ms=0 sync_ms=0 time_ms=443\n", "time=\"2020-12-05T02:36:58Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:36:58Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=112 fields.level=1 git_ms=17 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=204\n", "time=\"2020-12-05T02:36:59Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:00Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:00Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:01Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:01Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:04Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:05Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:06Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:06Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:08Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:09Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:10Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:10Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:11Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:11Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:11Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:11Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:14Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:37:14Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:37:14Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=119 fields.level=1 git_ms=13 health_ms=58 live_ms=2 settings_ms=0 sync_ms=0 time_ms=357\n", "time=\"2020-12-05T02:37:14Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02822-utlBJ\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02822-utlBJ tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=33\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=29\n", "time=\"2020-12-05T02:37:15Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:37:16Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=101 fields.level=1 git_ms=13 health_ms=23 live_ms=2 settings_ms=0 sync_ms=0 time_ms=311\n", "time=\"2020-12-05T02:37:19Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:21Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:29Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=271 fields.level=2 git_ms=255 health_ms=29 live_ms=19 settings_ms=0 sync_ms=0 time_ms=913\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:31Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=523 fields.level=1 git_ms=236 health_ms=118 live_ms=16 settings_ms=0 sync_ms=0 time_ms=1026\n", "time=\"2020-12-05T02:37:39Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:40Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:46Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:52Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:52Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:52Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:52Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:52Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:52Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:55Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:56Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:56Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:58Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:37:58Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:00Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:01Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:01Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=280 fields.level=1 git_ms=12 health_ms=27 live_ms=3 settings_ms=0 sync_ms=0 time_ms=392\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=195 fields.level=1 git_ms=14 health_ms=39 live_ms=7 settings_ms=0 sync_ms=0 time_ms=329\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=136 fields.level=1 git_ms=14 health_ms=44 live_ms=2 settings_ms=0 sync_ms=0 time_ms=253\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:02Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:04Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:05Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:06Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:06Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:08Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:08Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:08Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:08Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:10Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:10Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:10Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:10Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:10Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:10Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/engage-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=engage-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02822-utlBJ\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-pree9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=api-pree9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02822-utlBJ\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/realize-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=realize-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02822-utlBJ\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-post-migrate-rollback-e9aa074-presync--62135596800 created'\" application=shared1-main-chart-app kind=Job name=api-post-migrate-rollback-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02822-utlBJ\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/geography-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=geography-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02822-utlBJ\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/custom-schema-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=custom-schema-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02822-utlBJ\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=118 fields.level=1 git_ms=14 health_ms=29 live_ms=2 settings_ms=0 sync_ms=0 time_ms=349\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:14Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02824-XAHdZ\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02824-XAHdZ tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=154 fields.level=1 git_ms=22 health_ms=47 live_ms=3 settings_ms=0 sync_ms=0 time_ms=375\n", "time=\"2020-12-05T02:38:15Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:16Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=33\n", "time=\"2020-12-05T02:38:17Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=34\n", "time=\"2020-12-05T02:38:17Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:17Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=110 fields.level=1 git_ms=13 health_ms=26 live_ms=3 settings_ms=0 sync_ms=0 time_ms=288\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:20Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:30Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:32Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:32Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=116 fields.level=1 git_ms=12 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=204\n", "time=\"2020-12-05T02:38:33Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=144 fields.level=1 git_ms=15 health_ms=27 live_ms=3 settings_ms=0 sync_ms=0 time_ms=236\n", "time=\"2020-12-05T02:38:33Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:38:33Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=95 fields.level=1 git_ms=11 health_ms=27 live_ms=2 settings_ms=0 sync_ms=0 time_ms=201\n", "time=\"2020-12-05T02:38:36Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:42Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:46Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:48Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:48Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:48Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:48Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:48Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:48Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:52Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:52Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:52Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:56Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:56Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:57Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:59Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:59Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:38:59Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:01Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:02Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:02Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=113 fields.level=1 git_ms=11 health_ms=27 live_ms=2 settings_ms=0 sync_ms=0 time_ms=216\n", "time=\"2020-12-05T02:39:02Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:03Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=126 fields.level=1 git_ms=25 health_ms=34 live_ms=2 settings_ms=0 sync_ms=0 time_ms=244\n", "time=\"2020-12-05T02:39:03Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:03Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=112 fields.level=1 git_ms=12 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=199\n", "time=\"2020-12-05T02:39:03Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:03Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:04Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:04Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:04Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:04Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:07Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:07Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:07Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=105 fields.level=1 git_ms=14 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=367\n", "time=\"2020-12-05T02:39:07Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02826-Wimir\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02826-Wimir tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=38\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:08Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=109 fields.level=1 git_ms=13 health_ms=27 live_ms=7 settings_ms=0 sync_ms=0 time_ms=248\n", "time=\"2020-12-05T02:39:13Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:15Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:22Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:32Z\" level=info msg=\"Applying resource StatefulSet/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:33Z\" level=info msg=\"Applying resource IngressRoute/admin-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:34Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:34Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=106 fields.level=1 git_ms=12 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=189\n", "time=\"2020-12-05T02:39:34Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:34Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=96 fields.level=1 git_ms=10 health_ms=24 live_ms=2 settings_ms=0 sync_ms=0 time_ms=177\n", "time=\"2020-12-05T02:39:38Z\" level=info msg=\"Applying resource Middleware/all-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:41Z\" level=info msg=\"Applying resource IngressRoute/api-analytics-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:41Z\" level=info msg=\"Applying resource IngressRoute/custom-schema-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:41Z\" level=info msg=\"Applying resource IngressRoute/country-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:41Z\" level=info msg=\"Applying resource IngressRoute/api-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:41Z\" level=info msg=\"Applying resource IngressRoute/api-socket-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:41Z\" level=info msg=\"Applying resource IngressRoute/engage-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:46Z\" level=info msg=\"Applying resource Middleware/forward-auth in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:47Z\" level=info msg=\"Applying resource IngressRoute/geography-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:47Z\" level=info msg=\"Applying resource IngressRoute/identity-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:49Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:49Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/osrm-service-v3 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:50Z\" level=info msg=\"Applying resource Middleware/rate-limit in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:51Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:51Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=137 fields.level=1 git_ms=14 health_ms=35 live_ms=3 settings_ms=0 sync_ms=0 time_ms=249\n", "time=\"2020-12-05T02:39:51Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:51Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=122 fields.level=1 git_ms=24 health_ms=30 live_ms=3 settings_ms=0 sync_ms=0 time_ms=226\n", "time=\"2020-12-05T02:39:51Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=109 fields.level=1 git_ms=13 health_ms=28 live_ms=2 settings_ms=0 sync_ms=0 time_ms=271\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Applying resource IngressRoute/realize-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=44\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=40\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=232 fields.level=1 git_ms=36 health_ms=44 live_ms=16 settings_ms=0 sync_ms=0 time_ms=399\n", "time=\"2020-12-05T02:39:52Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:53Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=143 fields.level=1 git_ms=30 health_ms=32 live_ms=50 settings_ms=0 sync_ms=0 time_ms=313\n", "time=\"2020-12-05T02:39:53Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:53Z\" level=info msg=\"Applying resource Middleware/redirect-https-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:53Z\" level=info msg=\"Applying resource Middleware/retry-middleware in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:54Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=390 fields.level=1 git_ms=90 health_ms=49 live_ms=23 settings_ms=1 sync_ms=0 time_ms=797\n", "time=\"2020-12-05T02:39:54Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:39:54Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=115 fields.level=1 git_ms=14 health_ms=32 live_ms=2 settings_ms=0 sync_ms=1 time_ms=240\n", "time=\"2020-12-05T02:39:55Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=141\n", "time=\"2020-12-05T02:39:55Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=48\n", "time=\"2020-12-05T02:39:55Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:56Z\" level=info msg=\"Applying resource IngressRoute/routing-service-ingressroute in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:57Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:57Z\" level=info msg=\"Applying resource HorizontalPodAutoscaler/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:59Z\" level=info msg=\"Applying resource Job/slack-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:59Z\" level=info msg=\"Applying resource Job/slack-e9aa074-syncfail--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:59Z\" level=info msg=\"Applying resource Job/api-pre-migrate-rollback-e9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:39:59Z\" level=info msg=\"Applying resource Job/api-poste9aa074-postsync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:01Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:01Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:01Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:01Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:01Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:01Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/realize-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=realize-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02826-Wimir\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/engage-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=engage-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02826-Wimir\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-pree9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=api-pree9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02826-Wimir\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/custom-schema-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=custom-schema-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02826-Wimir\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/geography-service-e9aa074-presync--62135596800 configured'\" application=shared1-main-chart-app kind=Job name=geography-service-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02826-Wimir\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/api-post-migrate-rollback-e9aa074-presync--62135596800 created'\" application=shared1-main-chart-app kind=Job name=api-post-migrate-rollback-e9aa074-presync--62135596800 namespace=dev-shared1 phase=PreSync syncId=02826-Wimir\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=1 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=127 fields.level=1 git_ms=19 health_ms=46 live_ms=2 settings_ms=0 sync_ms=1 time_ms=284\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:40:05Z\" level=info msg=\"Namespace dev-shared1 is already existed.\" application=shared1-main-chart-app syncId=02828-zfLVR\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=tasks application=shared1-main-chart-app syncId=02828-zfLVR tasks=\"[PreSync/0 hook batch/Job:dev-shared1/api-post-migrate-rollback-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/api-pree9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/custom-schema-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/engage-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/geography-service-e9aa074-presync--62135596800 obj->obj (,,), PreSync/0 hook batch/Job:dev-shared1/realize-service-e9aa074-presync--62135596800 obj->obj (,,), Sync/0 resource /ConfigMap:dev-shared1/env obj->obj (,,), Sync/0 resource /Service:dev-shared1/country-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/engage-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/geography-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/identity-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/matching-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/osrm-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/realize-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/routing-service obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource /Service:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/country-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/custom-schema-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/engage-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/geography-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/identity-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/matching-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/realize-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/routing-service obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-admin obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-analytics obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), Sync/0 resource apps/Deployment:dev-shared1/sparelabs-api-socket obj->obj (,,), Sync/0 resource apps/StatefulSet:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/admin-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/all-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-analytics-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/api-socket-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/country-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/custom-schema-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/engage-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/forward-auth obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/geography-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/identity-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/matching-service obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/osrm-service-v3 obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/rate-limit obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/realize-service-ingressroute obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/redirect-https-middleware obj->obj (,,), Sync/0 resource traefik.containo.us/Middleware:dev-shared1/retry-middleware obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/routing-service obj->obj (,,), Sync/0 resource traefik.containo.us/IngressRoute:dev-shared1/routing-service-ingressroute obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api obj->obj (,,), Sync/0 resource autoscaling/HorizontalPodAutoscaler:dev-shared1/sparelabs-api-recurring-jobs obj->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-poste9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/api-pre-migrate-rollback-e9aa074-postsync--62135596800 nil->obj (,,), PostSync/0 hook batch/Job:dev-shared1/slack-e9aa074-postsync--62135596800 nil->obj (,,), SyncFail/0 hook batch/Job:dev-shared1/slack-e9aa074-syncfail--62135596800 nil->obj (,,)]\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Applying resource Job/api-post-migrate-rollback-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Applying resource Job/engage-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Applying resource Job/api-pree9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Applying resource Job/custom-schema-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Applying resource Job/realize-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Applying resource Job/geography-service-e9aa074-presync--62135596800 in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:06Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=202 fields.level=1 git_ms=21 health_ms=27 live_ms=3 settings_ms=0 sync_ms=0 time_ms=428\n", "time=\"2020-12-05T02:40:07Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=35\n", "time=\"2020-12-05T02:40:08Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" fields.level=0 time_ms=32\n", "time=\"2020-12-05T02:40:08Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:40:08Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=104 fields.level=1 git_ms=12 health_ms=25 live_ms=2 settings_ms=0 sync_ms=0 time_ms=241\n", "time=\"2020-12-05T02:40:10Z\" level=info msg=\"Applying resource ConfigMap/env in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/osrm-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:12Z\" level=info msg=\"Applying resource Service/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/matching-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/routing-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/sparelabs-admin in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/sparelabs-api in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/engage-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-analytics in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/country-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-recurring-jobs in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/custom-schema-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/sparelabs-api-socket in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/geography-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/identity-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:21Z\" level=info msg=\"Applying resource Deployment/realize-service in cluster: https://10.0.0.1:443, namespace: dev-shared1\"\n", "time=\"2020-12-05T02:40:23Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:40:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=111 fields.level=1 git_ms=15 health_ms=27 live_ms=2 settings_ms=0 sync_ms=0 time_ms=202\n", "time=\"2020-12-05T02:40:23Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n", "time=\"2020-12-05T02:40:23Z\" level=info msg=\"Reconciliation completed\" application=shared1-main-chart-app dedup_ms=0 dest-name= dest-namespace=dev-shared1 dest-server=\"https://kubernetes.default.svc\" diff_ms=139 fields.level=1 git_ms=13 health_ms=41 live_ms=2 settings_ms=0 sync_ms=0 time_ms=244\n", "time=\"2020-12-05T02:40:23Z\" level=info msg=\"Comparing app state (cluster: https://kubernetes.default.svc, namespace: dev-shared1)\" application=shared1-main-chart-app\n" ```
jessesuen commented 3 years ago

I think this might be fixed in v1.8. We were unexpectedly re-using job names in some circumstances. Would you be able to test/verify with the v1.8.0-rc2 candidate?

andloh commented 3 years ago

Hi, We see the same issue with a CRD with argocd.argoproj.io/hook: PreSync and argocd.argoproj.io/hook-delete-policy: HookSucceeded in v1.8.0-rc2

jim-leary commented 3 years ago

We're using v1.7.8 and are also experiencing the same problem that is not solved by v1.8.0-rc2. We have to stop the sync, delete all of the repeated pre-sync jobs, then start the sync again.

alexmt commented 3 years ago

https://github.com/argoproj/argo-cd/issues/3928 might be a root cause. Sync might stuck because Argo CD cannot delete pod with foreground deletion

alexmt commented 3 years ago

Discovered a terrible bug in sync retry implement. Multi-phase sync (sync that has hooks or sync waves) stuck after failure if retry is enabled (it enabled by default for auto-sync). Implemented fix: https://github.com/argoproj/argo-cd/pull/5017

@jim-leary , do you use auto-sync or explicitly specify sync retry ?

aindeev commented 3 years ago

do you use auto-sync or explicitly specify sync retry ?

@alexmt We are using auto-sync

alexmt commented 3 years ago

As soon as https://github.com/argoproj/argo-cd/pull/5017 is merged will cherry-pick it into both v1.8 and v1.7 .

alexmt commented 3 years ago

v1.8.1 and v1.7.11 are available. Can you please try new version?

RappC commented 3 years ago

I wonder if this issue also applies for the other hook types. At least I'm seeing the same behavior for the Sync hock. Once Synchronization of the app is terminated manually synching of the hook succeeds. Otherwise it runs forever.

sfynx commented 3 years ago

I'm seeing the same behavior for Sync hooks as well (I'm using this hook type to launch certain Jobs at the right sync wave during a sync). I find that is mostly happens when the hook fails during the first sync (e.g. due to image pull errors), and the hook succeeds during a next sync retry (e.g. image has been made available). After that the hooks in that sync wave succeed, but are immediately deleted and restarted afterwards (I use the BeforeHookCreation deletion policy), in an infinite cycle. Terminating the sync and letting it sync again resolves the issue.

However this does not happen every time, it is kinda hard to reproduce... So yeah, I see an explicit reference to PreSync in the fix, but would this also fix it for the Sync hooks?

Hope this helps.

sfynx commented 3 years ago

Actually looking at the fix again I see that the PreSync reference is only in the end to end test. I did not encounter the issue with v1.7.11 so far.

Issif commented 3 years ago

I'm also facing this issue randomly with initJobs, that are run with pre-install (Presync) hook:

"helm.sh/hook": pre-install

I'm using v1.8.1 of ArgoCD

image image

The jos has completed correctly:

image

Thanks.

aindeev commented 3 years ago

v1.8.1 and v1.7.11 are available. Can you please try new version?

We have been running v1.7.11 for last two weeks and have not experienced the issue with PreSync hooks after updating.

Issif commented 3 years ago

I think I've a clue. By migrating from 1.7.6 to 1.8.1, we've also set the replica to 3 for controller. We reduced the number to 1, stop all Syncing operations and everything was OK after few minutes. Our infrastructure is 1 ArgoCD for 1 Cluster, so the 3 controllers was managing the Apps in the same cluster. Is that a pattern to avoid? Multiple controllers is only for managing different clusters?

slayer commented 3 years ago

We have the same problem: image these jobs were already completed: image

argocd 1.8.3 (latest)

job definition:

apiVersion: batch/v1
kind: Job
metadata:
  name: xxx-db-init
  annotations:
    janitor/ttl: 1h
    "helm.sh/hook": pre-upgrade,pre-install
    "helm.sh/hook-delete-policy": hook-succeeded
    "helm.sh/hook-weight": "10"
sidiqputra commented 3 years ago

any update for this issue? I face the same issue on version 1.8.2.

slayer commented 3 years ago

@sidiqputra unfortunately this critical bug is not interested for team, they are busy on fixing non-critical issues

vineshkamble commented 3 years ago

We were facing same issue, we changed annotation as follow and its working as expected.

apiVersion: batch/v1 kind: Job metadata: name: xxx-db-init annotations: "helm.sh/hook": pre-install,pre-upgrade "helm.sh/hook-weight": "-1" "helm.sh/hook-delete-policy": hook-succeeded

ArnaudRinquin commented 3 years ago

@vineshkamble Is "helm.sh/hook-weight": "-1" the fix? How did you figure it solves the issue?

matang28 commented 3 years ago

After struggling with this issue for a month, blaming ArgoCD team for not prioritizing this issue :) eventually we saw that we had 2 argo application controllers running, probably left overs from some HA installation, who knows.

Screen Shot 2021-03-09 at 21 16 46

Long story short killing the one that doesn't belong to the stateful set fixed our problem (after syncing every old application), thought it worth mentioning.

ArnaudRinquin commented 3 years ago

@matang28 how did you get rid of this? Killed both pods and they came back.

Issif commented 3 years ago

have you migrated from 1.7 to 1.8? controller was a deployment and it's now a statefulset, if yoiu haven't cleaned up the deployment, it may remain after upgrade (depending of how you installed it of course).

matang28 commented 3 years ago

@ArnaudRinquin Just set the replica set to 0 or completely remove the k8s manifest. @Issif I guess your'e right things started to happen after migrating to v1.8 of argo.

fvillain commented 3 years ago

We have noted the same behaviour on our side with 1.8.7 in a ha-install cluster. We have tried scaling down the application-controller replicas count to 1 instead of 5 , and the problem disappear it seems.

Any idea where that might come from ?

Edit: I should say that this happens after a migration from 1.7.10 to 1.8.7

fvillain commented 3 years ago

Problem only occurs with jobs that have those annotations:

apiVersion: batch/v1
kind: Job
metadata:
  annotations:
    argocd.argoproj.io/hook: Sync
    argocd.argoproj.io/hook-delete-policy: BeforeHookCreation
    argocd.argoproj.io/sync-wave: '-1'
Anishmourya commented 3 years ago

@aindeev This was also happening with me but after a long time back and forth, I finally looked up SideCar Container is not stopping therefore POD always be in a running state, adding a Gracefully shutdown after Job manually Solve issue for me. I had used "shareProcessNamespace: true" In Job and after the Job completion manually killing the SideCar container "pkill -SIGINT service_name". FYI my ARGOCD version is:- v1.8.7

smark88 commented 3 years ago

Just ran into this, this week with v1.8.7. Is this resolved in v2.x.x ?

slayer commented 3 years ago

We didn't experience it anymore.

I am not sure, but I believe we cause of the problem was migrating from non-HA setup to HA without cleanup redis resources.

veerendra2 commented 3 years ago

We have same issue after we upgrade our ArgoCD 1.6 to 1.8. Before upgrade I completely removed application-controller and deployed v1.8. Is there any fix? or workaround?

smark88 commented 3 years ago

Circling back but we appear to be running 3 statefulset successfully in v1.8.7, initially we l over looked this environment var that is in the docs

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: argocd-application-controller
spec:
  replicas: 2
  template:
    spec:
      containers:
      - name: argocd-application-controller
        env:
        - name: ARGOCD_CONTROLLER_REPLICAS
          value: "2"
phortonssf commented 2 years ago

Argcd 1.7.7 with dryrun infinite loop with hooks. How to stop sync?

fujin commented 2 years ago

Hello. I am still seeing this in v2.2.4. PreSync hook is scheduled, Job starts, runs to completion, Argo sits there spinning "Progressing" until terminated. To work around it, we are terminating the op and using 'sync --strategy=apply' (disabling the hook) and running our job out of band.

Kube events during the sync confirm the job success. I no longer see the job/pod (per those events) if I check the namespace directly.

LAST SEEN   TYPE     REASON                   OBJECT                                                      MESSAGE
22m         Normal   Scheduled                pod/dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l   Successfully assigned dcs-prodemea-ns/dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l to gke-service-nap-e2-standard-8-1oj503q-5bf9adda-f9t6
22m         Normal   Pulling                  pod/dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l   Pulling image "gcr.io/dremio-1093/accept-release:v3"
21m         Normal   Pulled                   pod/dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l   Successfully pulled image "gcr.io/dremio-1093/accept-release:v3" in 48.040095979s
21m         Normal   Created                  pod/dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l   Created container dcs-artifact
21m         Normal   Started                  pod/dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l   Started container dcs-artifact
22m         Normal   SuccessfulCreate         job/dcs-artifact-promoter0ba458b-presync-1645132298         Created pod: dcs-artifact-promoter0ba458b-presync-1645132298-hqm9l
21m         Normal   Completed                job/dcs-artifact-promoter0ba458b-presync-1645132298         Job completed

image

It does not seem like #5017 fixed it. Let me know if I can provide any diagnostics to help.

lorelei-rupp-imprivata commented 2 years ago

We are seeing this too in latest argo v2.3.4 as well. We see batch/v1/Job idg idghellosvc-db-bootstrap Running Sync job.batch/idghellosvc-db-bootstrap created

Its been running for "days" We use annotations: argocd.argoproj.io/hook: Sync argocd.argoproj.io/sync-wave: "-2" as our annotations

sukantadash commented 2 years ago

Yes, the issue still exists 2.3.4 as well

lorelei-rupp-imprivata commented 2 years ago

Anyone find any good workarounds here, this is really impacting us and preventing deploys from happening because syncs are just stuck syncing. We tried going back to 2.0.3 but the issue was still there for us. We are now on latest argo and the issue is there too, hoping someone might have a good workaround

slayer commented 2 years ago

Anyone find any good workarounds here, this is really impacting us and preventing deploys from happening because syncs are just stuck syncing. We tried going back to 2.0.3 but the issue was still there for us. We are now on latest argo and the issue is there too, hoping someone might have a good workaround

In my case full reinstall of argocd helps.

as I mentioned before the cause was migrating from non-HA setup to HA

lorelei-rupp-imprivata commented 2 years ago

Anyone find any good workarounds here, this is really impacting us and preventing deploys from happening because syncs are just stuck syncing. We tried going back to 2.0.3 but the issue was still there for us. We are now on latest argo and the issue is there too, hoping someone might have a good workaround

In my case full reinstall of argocd helps.

as I mentioned before the cause was migrating from non-HA setup to HA

Actually we did just this, we removed HA for redis, repo server, and server and went back to single deployments. We also got all things that were "stuck syncing" unstuck by running a Sync "APPLY Only" and now we appear to be working again. We are going to monitor and slowly add HA back in for the repo server and server

chrisduong commented 1 year ago

my workaround is to delete the APP with "non cascade option".

adecchi-2inno commented 1 year ago

Hi Users, same problem from here. I have ArgoCD v2.3.2 and the ArgoCD Application Sync stuck forever waiting. I tried restarting the application-controller, repo-server, argocd-server, redis and continue in the same situation. Any idea, how can i force to stop it ?

Gentoli commented 1 year ago

still have this issue in 2.6.0. The job with helm.sh/hook: pre-install is completed and deleted but argocd is still thinks it's running.

image
MarkDPierce commented 10 months ago

I stumbled across this issue as well on version 2.8.4 I had the opportunity to delete the namespace of the app that was triggering this. This created a situation where ArgoCD still saw the app but it was no longer in K8S.

Running kubectl patch app APP_NAME -n argocd -p '{"metadata":{"finalizers":null}}' --type merge managed to allow the deletion to go through and I was able to redeploy.

So if you're working with a stateless deployment it might help you.

Piotr1215 commented 8 months ago

Still same issue running ArgoCD v2.5.10. Interestingly, the job sync was finally successful after over an hour duration.

MohammedNoureldin commented 7 months ago

I have just faced the same issue, where both Sync and Refresh got stuck. I just removed the application-controller-0 pod, after that the dead-lock was immediately resolved.

yash-sharma123456 commented 6 months ago

In the issue ArgoCD 2.10.2 also we faced this same issue. Our app had only 1 pre-sync hook for a job but ArgoCD app was in syncing state mentioning waiting for 16 hooks to be completed.

tchellomello commented 2 months ago

Hitting the same problem on argocd v2.10.6. Similar issue as reported by @Gentoli on https://github.com/argoproj/argo-cd/issues/4979#issuecomment-1529176537

kubectl get pods -w                                                                                       💠   ⎈ eks-cilium-d0abf06/envoy-gateway-system
NAME                            READY   STATUS    RESTARTS   AGE
eg-gateway-helm-certgen-zfq4f   0/1     Pending   0          0s
eg-gateway-helm-certgen-zfq4f   0/1     Pending   0          0s
eg-gateway-helm-certgen-zfq4f   0/1     ContainerCreating   0          0s
eg-gateway-helm-certgen-zfq4f   1/1     Running             0          7s
eg-gateway-helm-certgen-zfq4f   0/1     Completed           0          8s
eg-gateway-helm-certgen-zfq4f   0/1     Completed           0          9s
eg-gateway-helm-certgen-zfq4f   0/1     Completed           0          10s
eg-gateway-helm-certgen-zfq4f   0/1     Completed           0          10s
eg-gateway-helm-certgen-zfq4f   0/1     Terminating         0          10s
eg-gateway-helm-certgen-zfq4f   0/1     Terminating         0          10s

image

dtzar commented 2 months ago

I experienced this same problem on ArgoCD v2.11.4+e1284e1. The job completed in less than 30 seconds and the application sync was stuck for 15 minutes and likely longer. I just terminated it and did a re-sync and it worked fine and recognized that the job had already completed.

mateuszzawisza commented 2 months ago

Hello, we're getting the same thing. Happens once in a while and requires human intervention to terminate stuck sync and perform a new one. Recently while browsing the logs I've found some connection error messages. However if you take a look at timestamps this happened at 09:36:09 when our CI triggered yet another deployment (that also couldn't progress due to hanging hook from the previous one). While original deployment was triggered around 09:05:00. You can also see in the message Retrying attempt #1 at 9:08AM. So is it possible that it was never retried and later some information got lost? So we're stuck waiting for the hook indefinitely? 

Jul 11 09:36:09.000 msg="Updating operation state. phase: Running -> Running, message: 'ComparisonError: Failed to load target state: failed to generate manifest for source 1 of 5: rpc error: code = Unavailable desc = connection error: desc = \"transport: authentication handshake failed: context deadline exceeded\". Retrying attempt #1 at 9:08AM.' -> 'one or more tasks are running'" application=argocd/app-name-cluster-1 syncId=00003-orZMU
Jul 11 09:36:48.000 msg="Resuming in-progress operation. phase: Running, message: ComparisonError: Failed to load target state: failed to generate manifest for source 1 of 5: rpc error: code = Unavailable desc = connection error: desc = \"transport: authentication handshake failed: context deadline exceeded\". Retrying attempt #1 at 9:08AM." application=argocd/app-name-cluster-1
Jul 11 09:37:00.000 msg="Updating operation state. phase: Running -> Running, message: 'ComparisonError: Failed to load target state: failed to generate manifest for source 1 of 5: rpc error: code = Unavailable desc = connection error: desc = \"transport: authentication handshake failed: context deadline exceeded\". Retrying attempt #1 at 9:08AM.' -> 'waiting for completion of hook batch/Job/app-name-db-migrate'" application=argocd/app-name-cluster-1 syncId=00002-izGFn

ArgoCD version v2.11.2+25f7504.

Any help would be greatly appreciated. Maybe some configuration param would help to retry such operation if it is indeed due to connectivity issues?

jkleinlercher commented 1 month ago

Since ArgoCD helm chart now has also a webhook for redis we get this problem also with ArgoCD managing ArgoCD. It stays OutOfSync with this

waiting for completion of hook batch/Job/argocd-redis-secret-init


        - group: batch
          hookPhase: Running
          hookType: PreSync
          kind: Job
          message: job.batch/sx-argocd-redis-secret-init created
          name: sx-argocd-redis-secret-init
          namespace: argocd
          syncPhase: PreSync
          version: v1

that is really a problem …

dtzar commented 1 month ago

Same problem remains on 2.12-rc4. Job completes, stays stuck waiting for it forever. I manually terminate sync job, re-sync and detects the completed job.

mateuszzawisza commented 1 month ago

Following up to https://github.com/argoproj/argo-cd/issues/4979#issuecomment-2230951879

In our case we've found two things that contributed to the issue.

First we didn't have retries enabled. We turned them on via:

syncPolicy:
   retry:
        limit: 5
        backoff:
          duration: 5s
          factor: 2
          maxDuration: 3m

Secondly, we enabled priority classes in Kubernetes some time ago. We manage all our Kubernetes objects via Argo, except for Argo itself. As a result, we forgot to adjust the priorityClass for Argo, which ended up with a Low priority class. This caused ArgoCD to be pre-empted by its own deployments, leading to connection errors between ArgoCD components.

After enabling retries and raising ArgoCD’s priorityClass, the issue has been resolved. Either the retries addressed the intermittent problems, or the problems now occur so rarely that they are no longer noticeable.

Hope this is helpful to some facing similar problems 🤞