dbos-inc / dbos-transact

The TypeScript framework for backends that scale
https://docs.dbos.dev
MIT License
335 stars 22 forks source link

Kafka Retries #434

Closed kraftp closed 3 months ago

kraftp commented 3 months ago

This PR is a temporary workaround for https://github.com/tulios/kafkajs/pull/1558 until it gets fixed. If topic autocreation is on and you try to subscribe to a nonexistent topic, KafkaJS should retry until the topic is created. However, curently KafkaJS does not retry, so Transact will instead.

devhawk commented 3 months ago

Is there an issue on our side to remove this workaround when the kafkajs issue is resolved?

kraftp commented 3 months ago

Is there an issue on our side to remove this workaround when the kafkajs issue is resolved?

We'll make one after this is merged. The issue this is solving is tracked here: https://github.com/dbos-inc/dbos-transact/issues/426