search

CleverCloud / stream-dns

A DNS server written in Go with an event stream architecture, updated via kafka
MIT License
29 stars 2 forks source link

WIP: Add the Pulsar consumer to collect the DNS records #12

Closed NotBad4U closed 4 years ago

NotBad4U commented 5 years ago

work for #7

This PR adds the possibility to use consumer that collect DNS record through a Pulsar broker. The consumer is configurable by env variables: topic, address. We may allow more pulsar configurable items. :warning: The xor between Kafka, Pulsar is still not implemented.

NotBad4U commented 5 years ago

This pulsar issues #4055 on the go-client is the reason why the CI can't pass. The latest pulsar 2.3.1, compile report this error:

# github.com/apache/pulsar/pulsar-client-go/pulsar
../../../../pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20190502042238-97bc7e07aedf/pulsar/c_consumer.go:104:3: could not determine kind of name for C.pulsar_configure_set_negative_ack_redelivery_delay_ms
../../../../pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20190502042238-97bc7e07aedf/pulsar/c_consumer.go:133:4: could not determine kind of name for C.pulsar_consumer_configuration_set_schema_info
../../../../pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20190502042238-97bc7e07aedf/pulsar/c_consumer.go:313:2: could not determine kind of name for C.pulsar_consumer_negative_acknowledge
../../../../pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20190502042238-97bc7e07aedf/pulsar/c_consumer.go:318:2: could not determine kind of name for C.pulsar_consumer_negative_acknowledge_id
../../../../pkg/mod/github.com/apache/pulsar/pulsar-client-go@v0.0.0-20190502042238-97bc7e07aedf/pulsar/c_consumer.go:133:58: could not determine kind of name for C.pulsar_schema_type

It's seem's to be an error between the go client and cpp (the go client depend on the cpp). We have to wait until this issue is not solved.

Has a workaround and use this PR:

NotBad4U commented 4 years ago

Due to the recent decision take in #7, we close this PR and will open a new one with the alternative Pulsar client.