search

GoogleCloudPlatform / click-to-deploy

Source for Google Click to Deploy solutions listed on Google Cloud Marketplace.
Apache License 2.0
729 stars 444 forks source link

About some errors in the manually created elasticsearch template chart #1233

Closed espala closed 3 years ago

espala commented 3 years ago

Hello there,

I'm google cloud customer. I'm creating this chart manually. I choose version 6.8 and get an error when I run the resulting yaml file.

I'm changing the version to 6.3 and I'm getting the same error again.

I'm changed "6.3" to "6.3.2-20201213-154542" but again, the result is the same. Similarly, I applied it in version 6.8, I got the same result.

But when I deploy it in the "applications" section in the cloud panel, it can do it properly. In the auto-install scenario, when I checked yaml configurations, I didn't see any difference.

I share all the information below, any advice ?

gke version: 1.17.17-gke.3000

I created a manual helm template chart.

helm template chart/elasticsearch \
  --name-template "elasticsearch-cluster" \
  --namespace "elasticsearch" \
  --set elasticsearch.initImage="marketplace.gcr.io/google/elasticsearch/ubuntu16_04:6.8.13-20210404-144526" \
  --set elasticsearch.image.repo="marketplace.gcr.io/google/elasticsearch" \
  --set elasticsearch.image.tag="6.8.13-20210404-144526" \
  --set elasticsearch.replicas="3" \
  --set metrics.image="marketplace.gcr.io/google/elasticsearch/prometheus-to-sd:6.8.13-20210404-144526" \
  --set metrics.exporter.enabled="true" \
  > "test.yaml"

my yaml file

apiVersion: v1
kind: ConfigMap
metadata:
  name: elasticsearch-cluster-configmap
  namespace: elasticsearch
  labels:
    app.kubernetes.io/name: "elasticsearch-cluster"
    app.kubernetes.io/component: elasticsearch-server
data:
  elasticsearch.yml: |
    cluster.name: "${CLUSTER_NAME}"
    node.name: "${NODE_NAME}"

    path.data: /usr/share/elasticsearch/data
    path.repo: ["${BACKUP_REPO_PATH}"]

    network.host: 0.0.0.0

    discovery.seed_hosts: [ "${DISCOVERY_SERVICE}" ]
    cluster.initial_master_nodes: [ "elasticsearch-cluster-elasticsearch-0" ]

    node.master: true

  log4j2.properties: |
    status = error

    appender.console.type = Console
    appender.console.name = console
    appender.console.layout.type = PatternLayout
    appender.console.layout.pattern = [%d{ISO8601}][%-5p][%-25c{1.}] %marker%m%n

    rootLogger.level = info
    rootLogger.appenderRef.console.ref = console

---

apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-cluster-elasticsearch-prometheus-svc
  namespace: elasticsearch
  labels:
    app.kubernetes.io/name: elasticsearch-cluster
    app.kubernetes.io/component: elasticsearch-server
spec:
  clusterIP: None
  ports:
  - name: prometheus-port
    port: 9114
    protocol: TCP
  selector:
    app.kubernetes.io/name: elasticsearch-cluster
    app.kubernetes.io/component: elasticsearch-server

---

apiVersion: v1
kind: Service
metadata:
  name: elasticsearch-cluster-elasticsearch-svc
  namespace: elasticsearch
  labels:
    app.kubernetes.io/name: "elasticsearch-cluster"
    app.kubernetes.io/component: elasticsearch-server
spec:
  ports:
  - name: http
    port: 9200
  - name: tcp-transport
    port: 9300
  selector:
    app.kubernetes.io/name: "elasticsearch-cluster"
    app.kubernetes.io/component: elasticsearch-server
  type: ClusterIP

---

apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: elasticsearch-cluster-elasticsearch
  namespace: elasticsearch
  labels:
    app.kubernetes.io/name: "elasticsearch-cluster"
    app.kubernetes.io/component: elasticsearch-server
spec:
  selector:
    matchLabels:
      app.kubernetes.io/name: "elasticsearch-cluster"
      app.kubernetes.io/component: elasticsearch-server
  serviceName: elasticsearch-cluster-elasticsearch-svc
  replicas: 3
  updateStrategy:
      # The procedure for updating the Elasticsearch cluster is described at
      # https://www.elastic.co/guide/en/elasticsearch/reference/current/rolling-upgrades.html
      type: OnDelete
  template:
    metadata:
      labels:
        app.kubernetes.io/name: "elasticsearch-cluster"
        app.kubernetes.io/component: elasticsearch-server
    spec:
      terminationGracePeriodSeconds: 180
      initContainers:
      # This init container sets the appropriate limits for mmap counts on the hosting node.
      # https://www.elastic.co/guide/en/elasticsearch/reference/current/vm-max-map-count.html
      - name: set-max-map-count
        image: marketplace.gcr.io/google/elasticsearch/ubuntu16_04:6.8.13-20210404-144526
        imagePullPolicy: IfNotPresent
        securityContext:
          privileged: true
        command:
        - /bin/bash
        - -c
        - 'if [[ "$(sysctl vm.max_map_count --values)" -lt 262144 ]]; then sysctl -w vm.max_map_count=262144; fi'
      containers:
      - name: elasticsearch
        image: marketplace.gcr.io/google/elasticsearch:6.8.13-20210404-144526
        imagePullPolicy: Always
        env:
        - name: NODE_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: CLUSTER_NAME
          value: "elasticsearch-cluster-cluster"
        - name: DISCOVERY_SERVICE
          value: "elasticsearch-cluster-elasticsearch-svc"
        - name: BACKUP_REPO_PATH
          value: ""
        ports:
        - name: prometheus
          containerPort: 9114
          protocol: TCP
        - name: http
          containerPort: 9200
        - name: tcp-transport
          containerPort: 9300
        volumeMounts:
        - name: configmap
          mountPath: /etc/elasticsearch/elasticsearch.yml
          subPath: elasticsearch.yml
        - name: configmap
          mountPath: /etc/elasticsearch/log4j2.properties
          subPath: log4j2.properties
        - name: elasticsearch-cluster-elasticsearch-pvc
          mountPath: /usr/share/elasticsearch/data
        readinessProbe:
          httpGet:
            path: /_cluster/health?local=true
            port: 9200
          initialDelaySeconds: 5
        livenessProbe:
          exec:
            command:
            - /usr/bin/pgrep
            - -x
            - "java"
          initialDelaySeconds: 5
        resources:
          requests:
            memory: "2Gi"

      - name: prometheus-to-sd
        image: marketplace.gcr.io/google/elasticsearch/prometheus-to-sd:6.8.13-20210404-144526
        ports:
        - name: profiler
          containerPort: 6060
        command:
        - /monitor
        - --stackdriver-prefix=custom.googleapis.com
        - --source=elasticsearch:http://localhost:9114/metrics
        - --pod-id=$(POD_NAME)
        - --namespace-id=$(POD_NAMESPACE)
        - --monitored-resource-types=k8s
        env:
        - name: POD_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: POD_NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace

      volumes:
      - name: configmap
        configMap:
          name: "elasticsearch-cluster-configmap"
  volumeClaimTemplates:
  - metadata:
      name: elasticsearch-cluster-elasticsearch-pvc
      labels:
        app.kubernetes.io/name: "elasticsearch-cluster"
        app.kubernetes.io/component: elasticsearch-server
    spec:
      accessModes: [ "ReadWriteOnce" ]
      storageClassName: 
      resources:
        requests:
          storage: 5Gi

---

apiVersion: app.k8s.io/v1beta1
kind: Application
metadata:
  name: "elasticsearch-cluster"
  namespace: "elasticsearch"
  labels:
    app.kubernetes.io/name: "elasticsearch-cluster"
spec:
  descriptor:
    type: Elasticsearch
    version: "6.3"
    description: |-
      Elasticsearch is an open-source search engine that provides a distributed, multitenant-capable
      full-text search engine with an HTTP web interface and schema-free JSON documents.

      # Support
      Google does not offer support for this solution. However, community support is available on
      [Stack Overflow](https://stackoverflow.com/questions/tagged/elasticsearch/).
      Additional community support is available on [elastic.co forums](https://discuss.elastic.co/).
    maintainers:
    - name: Google Click to Deploy
      url: https://cloud.google.com/solutions/#click-to-deploy
    links:
    - description: 'User Guide: Google Click to Deploy Elasticsearch'
      url: https://github.com/GoogleCloudPlatform/click-to-deploy/blob/master/k8s/elasticsearch/README.md
    - description: 'Elasticsearch: Getting Started'
      url: https://www.elastic.co/webinars/getting-started-elasticsearch
    notes: |-
      # Expose Elasticsearch service

      By default, the service does not have an external IP. Run the
      following command to expose an external IP:

  kubectl patch service/"elasticsearch-cluster-elasticsearch-svc" \
    --namespace "elasticsearch" \
    --patch '{"spec": {"type": "LoadBalancer"}}'
  ```

    # Access Elasticsearch

    Get the external IP of the Elasticsearch service:

  ```
  SERVICE_IP=$(kubectl get service/elasticsearch-cluster-elasticsearch-svc \
    --namespace elasticsearch \
    --output jsonpath='{.status.loadBalancer.ingress[0].ip}')

  echo "http://${SERVICE_IP}:9200"
  ```

  Note that it might take some time for the external IP to be provisioned.

  # Scale the cluster

  To scale the cluster, use either a GKE UI (use the Scale option in the
  StatefulSet details screen) or the following command:

  ```
  kubectl scale statefulsets "elasticsearch-cluster-elasticsearch" \
    --namespace "elasticsearch" --replicas=<new-replicas>
  ```

  By default, there are 2 replicas to satisfy the minimum master quorum.
  To increase resilience, it is recommended to scale the number of replicas
  to at least 3.

  For more information about the StatefulSets scaling, check the
  [Kubernetes documentation](https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/#kubectl-scale).

selector: matchLabels: app.kubernetes.io/name: "elasticsearch-cluster" componentKinds:

list pods and describe pod

kubectl get pod
NAME                                    READY   STATUS             RESTARTS   AGE
elasticsearch-cluster-elasticsearch-0   1/2     CrashLoopBackOff   4          3m45s

kubectl describe pod elasticsearch-cluster-elasticsearch-0
Name:         elasticsearch-cluster-elasticsearch-0
Namespace:    elasticsearch
Priority:     0
Node:         kubernetes-node1--e94c45f2-ar72/10.200.35.208
Start Time:   Fri, 16 Apr 2021 07:03:46 +0300
Labels:       app.kubernetes.io/component=elasticsearch-server
              app.kubernetes.io/name=elasticsearch-cluster
              controller-revision-hash=elasticsearch-cluster-elasticsearch-854878c988
              statefulset.kubernetes.io/pod-name=elasticsearch-cluster-elasticsearch-0
Annotations:  <none>
Status:       Running
IP:           10.10.3.35
IPs:
  IP:           10.10.3.35
Controlled By:  StatefulSet/elasticsearch-cluster-elasticsearch
Init Containers:
  set-max-map-count:
    Container ID:  docker://ea7db655551dd087642c89e832962322dff62fa0ffcc61d746c1e95b1b800312
    Image:         marketplace.gcr.io/google/elasticsearch/ubuntu16_04:6.3
    Image ID:      docker-pullable://marketplace.gcr.io/google/elasticsearch/ubuntu16_04@sha256:172b454f420ecd9efed04c6455ee901225d5809de0bb45dd5a10e5385a904341
    Port:          <none>
    Host Port:     <none>
    Command:
      /bin/bash
      -c
      if [[ "$(sysctl vm.max_map_count --values)" -lt 262144 ]]; then sysctl -w vm.max_map_count=262144; fi
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 16 Apr 2021 07:04:05 +0300
      Finished:     Fri, 16 Apr 2021 07:04:05 +0300
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-lbnbl (ro)
Containers:
  elasticsearch:
    Container ID:   docker://0ea414823fa33cbb69317ffb9867223cafc2ad2d0cdac1af69737e5ecc6845e5
    Image:          marketplace.gcr.io/google/elasticsearch:6.3
    Image ID:       docker-pullable://marketplace.gcr.io/google/elasticsearch@sha256:2916f9ed2ae9349e04f09d37da6f99f70db1da9c2969e249a9f7db463969592a
    Ports:          9114/TCP, 9200/TCP, 9300/TCP
    Host Ports:     0/TCP, 0/TCP, 0/TCP
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Fri, 16 Apr 2021 07:06:55 +0300
      Finished:     Fri, 16 Apr 2021 07:07:12 +0300
    Ready:          False
    Restart Count:  4
    Requests:
      memory:   2Gi
    Liveness:   exec [/usr/bin/pgrep -x java] delay=5s timeout=1s period=10s #success=1 #failure=3
    Readiness:  http-get http://:9200/_cluster/health%3Flocal=true delay=5s timeout=1s period=10s #success=1 #failure=3
    Environment:
      NODE_NAME:          elasticsearch-cluster-elasticsearch-0 (v1:metadata.name)
      CLUSTER_NAME:       elasticsearch-cluster-cluster
      DISCOVERY_SERVICE:  elasticsearch-cluster-elasticsearch-svc
      BACKUP_REPO_PATH:
    Mounts:
      /etc/elasticsearch/elasticsearch.yml from configmap (rw,path="elasticsearch.yml")
      /etc/elasticsearch/log4j2.properties from configmap (rw,path="log4j2.properties")
      /usr/share/elasticsearch/data from elasticsearch-cluster-elasticsearch-pvc (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-lbnbl (ro)
  prometheus-to-sd:
    Container ID:  docker://3cea47a55288979252bd142153c8d66ce15744cdfba2ecb87d8ae4687032c364
    Image:         marketplace.gcr.io/google/elasticsearch/prometheus-to-sd:6.3
    Image ID:      docker-pullable://marketplace.gcr.io/google/elasticsearch/prometheus-to-sd@sha256:8e3679a6e059d1806daae335ab08b304fd1d8d35cdff457baded7306b5af9ba5
    Port:          6060/TCP
    Host Port:     0/TCP
    Command:
      /monitor
      --stackdriver-prefix=custom.googleapis.com
      --source=elasticsearch:http://localhost:9114/metrics
      --pod-id=$(POD_NAME)
      --namespace-id=$(POD_NAMESPACE)
      --monitored-resource-types=k8s
    State:          Running
      Started:      Fri, 16 Apr 2021 07:04:26 +0300
    Ready:          True
    Restart Count:  0
    Environment:
      POD_NAME:       elasticsearch-cluster-elasticsearch-0 (v1:metadata.name)
      POD_NAMESPACE:  elasticsearch (v1:metadata.namespace)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-lbnbl (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  elasticsearch-cluster-elasticsearch-pvc:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  elasticsearch-cluster-elasticsearch-pvc-elasticsearch-cluster-elasticsearch-0
    ReadOnly:   false
  configmap:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      elasticsearch-cluster-configmap
    Optional:  false
  default-token-lbnbl:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-lbnbl
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                 node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason                  Age                    From                     Message
  ----     ------                  ----                   ----                     -------
  Normal   Scheduled               3m53s                  default-scheduler        Successfully assigned elasticsearch/elasticsearch-cluster-elasticsearch-0 to kubernetes-node1--e94c45f2-ar72
  Normal   SuccessfulAttachVolume  3m49s                  attachdetach-controller  AttachVolume.Attach succeeded for volume "pvc-53fce899-76e2-4253-af8d-8e5f20a4793f"
  Normal   Pulling                 3m43s                  kubelet                  Pulling image "marketplace.gcr.io/google/elasticsearch/ubuntu16_04:6.3"
  Normal   Pulled                  3m35s                  kubelet                  Successfully pulled image "marketplace.gcr.io/google/elasticsearch/ubuntu16_04:6.3"
  Normal   Created                 3m34s                  kubelet                  Created container set-max-map-count
  Normal   Started                 3m34s                  kubelet                  Started container set-max-map-count
  Normal   Pulling                 3m14s                  kubelet                  Pulling image "marketplace.gcr.io/google/elasticsearch/prometheus-to-sd:6.3"
  Normal   Created                 3m13s                  kubelet                  Created container prometheus-to-sd
  Normal   Pulled                  3m13s                  kubelet                  Successfully pulled image "marketplace.gcr.io/google/elasticsearch/prometheus-to-sd:6.3"
  Normal   Started                 3m13s                  kubelet                  Started container prometheus-to-sd
  Normal   Created                 2m26s (x3 over 3m14s)  kubelet                  Created container elasticsearch
  Normal   Pulled                  2m26s (x3 over 3m16s)  kubelet                  Successfully pulled image "marketplace.gcr.io/google/elasticsearch:6.3"
  Normal   Pulling                 2m26s (x3 over 3m33s)  kubelet                  Pulling image "marketplace.gcr.io/google/elasticsearch:6.3"
  Normal   Started                 2m25s (x3 over 3m14s)  kubelet                  Started container elasticsearch
  Warning  Unhealthy               2m20s (x2 over 3m)     kubelet                  Readiness probe failed: Get http://10.10.3.35:9200/_cluster/health?local=true: dial tcp 10.10.3.35:9200: connect: connection refused
  Warning  BackOff                 2m14s (x3 over 2m41s)  kubelet                  Back-off restarting failed container

version 6.3 log

kubectl logs -f elasticsearch-cluster-elasticsearch-0 -c elasticsearch

OpenJDK 64-Bit Server VM warning: Cannot open file /var/log/elasticsearch/gc.log due to Permission denied

[2021-04-16T04:05:17,034][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] initializing ...
[2021-04-16T04:05:17,175][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch-cluster-elasticsearch-0] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sdb)]], net usable_space [4.8gb], net total_space [4.8gb], types [ext4]
[2021-04-16T04:05:17,179][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch-cluster-elasticsearch-0] heap size [1015.6mb], compressed ordinary object pointers [true]
[2021-04-16T04:05:17,182][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] node name [elasticsearch-cluster-elasticsearch-0], node ID [ckxWADgHS92nbfG2Oc8ozA]
[2021-04-16T04:05:17,183][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] version[6.3.2], pid[1], build[default/deb/053779d/2018-07-20T05:20:23.451332Z], OS[Linux/4.19.150+/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_252/25.252-b09]
[2021-04-16T04:05:17,183][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.7OHbZPV1, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb]
[2021-04-16T04:05:21,216][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [aggs-matrix-stats]
[2021-04-16T04:05:21,216][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [analysis-common]
[2021-04-16T04:05:21,216][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [ingest-common]
[2021-04-16T04:05:21,217][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [lang-expression]
[2021-04-16T04:05:21,217][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [lang-mustache]
[2021-04-16T04:05:21,217][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [lang-painless]
[2021-04-16T04:05:21,217][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [mapper-extras]
[2021-04-16T04:05:21,217][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [parent-join]
[2021-04-16T04:05:21,218][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [percolator]
[2021-04-16T04:05:21,218][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [rank-eval]
[2021-04-16T04:05:21,218][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [reindex]
[2021-04-16T04:05:21,218][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [repository-url]
[2021-04-16T04:05:21,219][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [transport-netty4]
[2021-04-16T04:05:21,220][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [tribe]
[2021-04-16T04:05:21,220][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-core]
[2021-04-16T04:05:21,221][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-deprecation]
[2021-04-16T04:05:21,221][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-graph]
[2021-04-16T04:05:21,221][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-logstash]
[2021-04-16T04:05:21,222][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-ml]
[2021-04-16T04:05:21,223][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-monitoring]
[2021-04-16T04:05:21,223][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-rollup]
[2021-04-16T04:05:21,223][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-security]
[2021-04-16T04:05:21,223][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-sql]
[2021-04-16T04:05:21,224][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-upgrade]
[2021-04-16T04:05:21,224][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-watcher]
[2021-04-16T04:05:21,225][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] no plugins loaded
[2021-04-16T04:05:25,305][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [elasticsearch-cluster-elasticsearch-0] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown setting [discovery.seed_hosts] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
  at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:140) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:127) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.3.2.jar:6.3.2]
  at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:86) ~[elasticsearch-6.3.2.jar:6.3.2]
Caused by: java.lang.IllegalArgumentException: unknown setting [discovery.seed_hosts] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
  at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:344) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:308) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:282) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:135) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.node.Node.<init>(Node.java:339) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.node.Node.<init>(Node.java:252) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:326) ~[elasticsearch-6.3.2.jar:6.3.2]
  at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-6.3.2.jar:6.3.2]
  ... 6 more
  Suppressed: java.lang.IllegalArgumentException: unknown setting [cluster.initial_master_nodes] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:344) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:308) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:282) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:135) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.node.Node.<init>(Node.java:339) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.node.Node.<init>(Node.java:252) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:326) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:127) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.3.2.jar:6.3.2]
    at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:86) ~[elasticsearch-6.3.2.jar:6.3.2]

version 6.8 log

warning: Falling back to java on path. This behavior is deprecated. Specify JAVA_HOME
OpenJDK 64-Bit Server VM warning: Cannot open file /var/log/elasticsearch/gc.log due to Permission denied

[2021-04-18T17:25:47,628][WARN ][o.e.c.l.LogConfigurator  ] [elasticsearch-cluster-elasticsearch-0] Some logging configurations have %marker but don't have %node_name. We will automatically add %node_name to the pattern to ease the migration for users who customize log4j2.properties but will stop this behavior in 7.0. You should manually replace `%node_name` with `[%node_name]%marker ` in these locations:
  /etc/elasticsearch/log4j2.properties
[2021-04-18T17:25:48,228][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch-cluster-elasticsearch-0] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sdc)]], net usable_space [4.8gb], net total_space [4.8gb], types [ext4]
[2021-04-18T17:25:48,236][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch-cluster-elasticsearch-0] heap size [1015.6mb], compressed ordinary object pointers [true]
[2021-04-18T17:25:48,243][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] node name [elasticsearch-cluster-elasticsearch-0], node ID [ckxWADgHS92nbfG2Oc8ozA]
[2021-04-18T17:25:48,247][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] version[6.8.13], pid[1], build[default/deb/be13c69/2020-10-16T09:09:46.555371Z], OS[Linux/4.19.150+/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_272/25.272-b10]
[2021-04-18T17:25:48,248][INFO ][o.e.n.Node               ] [elasticsearch-cluster-elasticsearch-0] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-1898413064018500818, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb]
[2021-04-18T17:25:52,621][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [aggs-matrix-stats]
[2021-04-18T17:25:52,622][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [analysis-common]
[2021-04-18T17:25:52,623][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [ingest-common]
[2021-04-18T17:25:52,623][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [ingest-geoip]
[2021-04-18T17:25:52,624][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [ingest-user-agent]
[2021-04-18T17:25:52,624][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [lang-expression]
[2021-04-18T17:25:52,624][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [lang-mustache]
[2021-04-18T17:25:52,625][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [lang-painless]
[2021-04-18T17:25:52,625][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [mapper-extras]
[2021-04-18T17:25:52,625][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [parent-join]
[2021-04-18T17:25:52,625][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [percolator]
[2021-04-18T17:25:52,625][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [rank-eval]
[2021-04-18T17:25:52,625][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [reindex]
[2021-04-18T17:25:52,626][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [repository-url]
[2021-04-18T17:25:52,626][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [transport-netty4]
[2021-04-18T17:25:52,626][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [tribe]
[2021-04-18T17:25:52,626][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-ccr]
[2021-04-18T17:25:52,626][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-core]
[2021-04-18T17:25:52,627][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-deprecation]
[2021-04-18T17:25:52,627][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-graph]
[2021-04-18T17:25:52,627][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-ilm]
[2021-04-18T17:25:52,627][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-logstash]
[2021-04-18T17:25:52,627][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-ml]
[2021-04-18T17:25:52,628][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-monitoring]
[2021-04-18T17:25:52,628][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-rollup]
[2021-04-18T17:25:52,628][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-security]
[2021-04-18T17:25:52,628][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-sql]
[2021-04-18T17:25:52,628][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-upgrade]
[2021-04-18T17:25:52,629][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] loaded module [x-pack-watcher]
[2021-04-18T17:25:52,630][INFO ][o.e.p.PluginsService     ] [elasticsearch-cluster-elasticsearch-0] no plugins loaded
[2021-04-18T17:25:57,488][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [elasticsearch-cluster-elasticsearch-0] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown setting [discovery.seed_hosts] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.8.13.jar:6.8.13]
    at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:116) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.8.13.jar:6.8.13]
Caused by: java.lang.IllegalArgumentException: unknown setting [discovery.seed_hosts] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:530) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:475) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:446) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:417) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:148) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.node.Node.<init>(Node.java:374) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.node.Node.<init>(Node.java:266) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:212) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:212) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) ~[elasticsearch-6.8.13.jar:6.8.13]
    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-6.8.13.jar:6.8.13]
    ... 6 more
    Suppressed: java.lang.IllegalArgumentException: unknown setting [cluster.initial_master_nodes] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:530) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:475) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:446) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:417) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:148) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.node.Node.<init>(Node.java:374) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.node.Node.<init>(Node.java:266) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:212) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:212) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.8.13.jar:6.8.13]
        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:116) ~[elasticsearch-6.8.13.jar:6.8.13]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.8.13.jar:6.8.13]
espala commented 3 years ago

Additional question;

Why don't you still support 7.10? There are significant improvements between 6.8 and the 7.10 or latest (7.12) version.

It looks like you are not very interested.

armandomiani commented 3 years ago

@espala , thank you for the contribution. We are checking the issue and as soon we have some update we will keep you posted.

Best regards,