telicent-oss / jena-fuseki-kafka

Apache Jena Fuseki extension module for receiving data over Apache Kafka topics.
Apache License 2.0
9 stars 3 forks source link

Support Kafka configuration files and validate Secure Kafka cluster connectivity (CORE-478) #107

Closed rvesse closed 4 weeks ago

rvesse commented 4 weeks ago

This PR adds a new fk:configFile property into the Jena Assembler support so that an external Kafka configuration file can be injected into the Fuseki Kafka configuration. This then allows for supporting connections to secure Kafka Clusters that require sensitive configuration that we don't want to inject directly into the Fuseki configuration file itself.

As part of this work refactored the integration tests to use KafkaTestCluster from Smart Caches Core and use TestNG as that made it far easier to drop in alternative Kafka cluster types

Related Issues and Tasks

TelicentPaul commented 4 weeks ago

Nice touch with the recent commit - obviously disregard my version comment above.

rvesse commented 4 weeks ago

Nice touch with the recent commit - obviously disregard my version comment above.

Yeah sorry, I thought I'd done a version bump and then realised I hadn't because we got a weird transient failure with the 1.4.0 release so I had to manually create the GitHub release for it