log-pilot采集日志无法跟上业务输出的日志

[huoxinyang]

配置：

• name: GOMAXPROCS value: "4"
• name: PILOT_LOG_PREFIX value: ops
• name: LOGGING_OUTPUT value: kafka
• name: KAFKA_BROKERS value: xxx
• name: KAFKA_SASL_MECHANISM value: SCRAM-SHA-512
• name: KAFKA_USERNAME value: logger
• name: KAFKA_PASSWORD value:x x x
• name: KAFKA_WORKER value: "16"
• name: KAFKA_CLIENT_ID value: beats
• name: KAFKA_BROKER_TIMEOUT value: "90"
• name: KAFKA_KEEP_ALIVE value: 300s
• name: KAFKA_REQUIRE_ACKS value: "0"
• name: KAFKA_BULK_MAX_SIZE value: "40000"
• name: KAFKA_CHANNEL_BUFFER_SIZE value: "20000"
• name: KAFKA_MAX_MESSAGE_BYTES value: "20000000"
• name: KAFKA_COMPRESSION value: lz4
• name: FILEBEAT_MAX_PROCS value: "8"
• name: FILEBEAT_LOG_LEVEL value: debug
• name: FILEBEAT_LOG_MAX_SIZE value: "536870912"
• name: FILEBEAT_LOG_MAX_FILE value: "7"
• name: QUEUE_MEM_EVENTS value: "40000"
• name: QUEUE_MEM_FLUSH_MIN_EVENTS value: "4000"
• name: QUEUE_MEM_FLUSH_TIMEOUT value: 5s limits是8c8g，但是实际利用率很低，如何优化配置呢？

[huoxinyang]

关键的是业务日志量不算太大，一小时大概10G左右