This PR proposes support for handling new sections in the Kafka config file (/etc/kafka.yml by default). The new sections are currently optional but are expected to become required in the future. Two of the new sections are actually ignored, but have some test coverage.
The new sections specify shared security configuration for producers and consumers, limited consumer-specific configuration, and a list of topic templates for RunEngine producers.
This is an example of a configuration file with all optional sections:
The last three sections, producer_consumer_security_config, consumer_config, and runengine_topics are new and optional. The last two are currently ignored by nslsii.configure_base.
In addition, this PR simplifies the docker-compose script for running Kafka in a container.
This PR proposes support for handling new sections in the Kafka config file (/etc/kafka.yml by default). The new sections are currently optional but are expected to become required in the future. Two of the new sections are actually ignored, but have some test coverage.
The new sections specify shared security configuration for producers and consumers, limited consumer-specific configuration, and a list of topic templates for RunEngine producers.
This is an example of a configuration file with all optional sections:
The last three sections,
producer_consumer_security_config
,consumer_config
, andrunengine_topics
are new and optional. The last two are currently ignored bynslsii.configure_base
.In addition, this PR simplifies the docker-compose script for running Kafka in a container.