k8s환경에서의 pinpoint-collector와 pinpoint-web을 hbase의 service를 바라보도록 설정하는법

[moondal]

Hello. I am testing to convert the pinpoints you provided as dockers to the k8s environment.

Hbase and zookeeper built as standalone as the default setting for Apache..

The hbase is also created as a pod, and the master is also displayed as a pod name. The pinpoint-collector and the pinpoint-web are trying to communicate with the hbase pod despite no settings.

I was wondering how can I convert hbase to service IP of kubernetes in pinpoint collector and pinpoint web.

Additionally, I would like to ask if there is any help provided by k8s. The data I found is two years old, so I'd like to ask if you have the latest data

[donghun-cho]

Please ask questions in English so that all pinpoint users can check the contents.

It seems that the HBase address is correctly configured, so is this issue with resolving address in k8s environments?

[moondal]

I translated it into English. You did not set the hbase address, but Pinpoint-collector and pinpoint-web try to call the hbase pod.

[donghun-cho]

hbase.properties https://github.com/pinpoint-apm/pinpoint/blob/e8f0f49b41dda3d58b6bb08c654cc65286a39685/web/src/main/resources/hbase-root.properties#L1-L2

in docker-compose instead of hbase.client.host environment variable PINPOINT_ZOOKEEPER_ADDRESS is used

• https://github.com/pinpoint-apm/pinpoint-docker/blob/092a913d5c1a89e70535b4efe60282518786b42a/docker-compose.yml#L144-L146
• Hbase cluster metadata is stored in zookeeper. Make sure the collector server can resolve hbase address obtained from zookeeper.

Additionally, I would like to ask if there is any help provided by k8s

https://github.com/pinpoint-apm/pinpoint-kubernetes hasn't been updated recently. Since Docker Compose has been updated well, it would be better to convert and use it.

There are two references that might help

• https://github.com/pinpoint-apm/pinpoint-kubernetes/pull/22
• https://github.com/donghun-cho/pinpoint-kubernetes/tree/2.5.x-test
  • Unfinished. only the web and collector Helm charts are tested.

[moondal]

apiVersion: v1 kind: ConfigMap metadata: name: pinpoint-collector-configmap data: start-collector-metric.sh: |

!/bin/bash

hbase.client.host=pinpoint-hbase
hbase.client.port=2181
set -e
set -x
exec java -jar /pinpoint/pinpoint-collector-boot.jar --spring.config.additional-location=/pinpoint/config/pinpoint-collector.properties --pinpoint.collector.type=ALL

---

apiVersion: apps/v1 kind: Deployment metadata: name: pinpoint-collector spec: replicas: 1 selector: matchLabels: app: pinpoint-collector template: metadata: labels: app: pinpoint-collector spec: containers:

• name: pinpoint-collector command: ["/bin/bash", "/configmap/start-collector-metric.sh"] volumeMounts:
  • name: configmap mountPath: /configmap image: pinpointdocker/pinpoint-collector:2.5.3 command: ["/bin/bash", "/configmap/start-collector-metric.sh"] ports:
  • containerPort: 9991 name: grpc-agent protocol: TCP
  • containerPort: 9992 name: grpc-stat protocol: TCP
  • containerPort: 9993 name: grpc-span protocol: TCP
  • containerPort: 9994 name: base-port protocol: TCP
  • containerPort: 9995 name: stat-udp protocol: UDP
  • containerPort: 9996 name: span-udp protocol: UDP env:
  • name: SPRING_PROFILES_ACTIVE value: "release"
  • name: PINPOINT_ZOOKEEPER_ADDRESS value: "zoo1"
  • name: CLUSTER_ENABLE value: "true"
  • name: LOGGING_LEVEL_ROOT value: "INFO"
  • name: FLINK_CLUSTER_ENABLE value: "true"
  • name: FLINK_CLUSTER_ZOOKEEPER_ADDRESS value: "zoo1"
  • name: JAVA_OPTS value: "-Dspring.profiles.active=release"
  • name: HBASE_HOST value: "pinpoint-hbase" volumeMounts:
  • name: configmap mountPath: /configmap volumes:
• name: configmap configMap: name: pinpoint-collector-configmap defaultMode: 0755

It is already set to zookeeper. Still looking for dns as a pod.

    - name: PINPOINT_ZOOKEEPER_ADDRESS
      value: "zoo1"

06-04 04:07:17.017 [htable-pool4-t1] INFO o.a.h.h.c.RpcRetryingCaller : Call exception, tries=10, retries=35, started=38416 ms ago, cancelled=false, msg=pinpoint-hbase-6fcd554b99-kxkpq:16201 could not be resolved, details=row 'AgentInfo,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=pinpoint-hbase-6fcd554b99-kxkpq,16201,1717390997262, seqNum=0, see https://s.apache.org/timeout

Should I set the Hbase hostname to hbase servicename in the zookeeper setting?

I would like to ask if there is a method or environment variable to change from zookeeper to hbase servicename.

pinpoint-hbase ClusterIP 10.254.158.111 60000/TCP,16010/TCP,60020/TCP,16030/TCP pinpoint-mysql ClusterIP 10.254.148.85 3306/TCP pinpoint-web ClusterIP 10.254.244.201 8080/TCP,9997/TCP
zoo1 ClusterIP 10.254.159.95 2181/TCP

Thank you.

[donghun-cho]

I think this is not a problem with the pinpoint collector configuration. It is an issue with the Kubernetes environment and HBase cluster settings.

You should check the kubernetes and Hbase documentation for things like

• kubernetes service, fqdn, and hostAlias
• Hbase cluster configuration