KSQL_KSQL_HEARTBEAT_ENABLE settings inquiry

[sdYoo]

Hi!

I am running ksqldb in 2 pods. I enable ksql's "KSQL_KSQL_HEARTBEAT_ENABLE" setting I get excessive logs. Changing the KSQL_KSQL_HEARTBEAT_ENABLE setting to false will reduce the log. However, I would like to know if there are any issues when changing the setting to false when two devices are in operation. so ksqldb settings are also shared.

1. What happens if I disable the "KSQL_KSQL_HEARTBEAT_ENABLE" setting?
2. Is there a way to reduce the communication log with the "KSQL KSQL HEARTBEAT ENABLE" setting enabled?

**ref. ksqldb deployment yaml spec: progressDeadlineSeconds: 600 replicas: 2 revisionHistoryLimit: 10 .............. ..............

• env:
  • name: KSQL_HEAP_OPTS value: '-Xms4G -Xmx4G'
  • name: KSQL_LISTENERS value: 'http://0.0.0.0:8088'
  • name: KSQL_KSQL_HEARTBEAT_ENABLE value: 'true'
  • name: KSQL_KSQL_INTERNAL_TOPIC_MIN_INSYNC_REPLICAS value: '2'
  • name: KSQL_KSQL_INTERNAL_TOPIC_REPLICAS value: '3'
  • name: KSQL_KSQL_LAG_REPORTING_ENABLE value: 'true'
  • name: KSQL_KSQL_QUERY_PULL_ENABLE_STANDBY_READS value: 'true'
  • name: KSQL_KSQL_QUERY_PULL_TABLE_SCAN_ENABLE value: 'true'
  • name: KSQL_KSQL_SINK_REPLICAS value: '3'
  • name: KSQL_KSQL_STREAMS_NUM_STANDBY_REPLICAS value: '2'
  • name: KSQL_KSQL_STREAMS_PRODUCER_ACKS value: all
  • name: KSQL_KSQL_STREAMS_REPLICATION_FACTOR value: '3'
  • name: KSQL_KSQL_STREAMS_TOPIC_MIN_INSYNC_REPLICAS value: '2'

[sdYoo]

@ijuma @sullis @codyaray @ewencp Does anyone know what happens when this "KSQL_KSQL_HEARTBEAT_ENABLE" setting is changed to false?

[juanluhidalgo]

Hi, if the problem are the logs you can disable just with this https://docs.ksqldb.io/en/latest/reference/server-configuration/#ksqlendpointloggingignoredpathsregex

My recommendation would be to keep the heartbeat enabled and adjust the interval of the heartbeats which is pretty aggressive.