search

robinhood / faust

Python Stream Processing
Other
6.7k stars 538 forks source link

Couldn't set Retry Topic mechanism In Faust Streaming #769

Open rawheel opened 1 year ago

rawheel commented 1 year ago

Checklist

Hello all, I’m using faust-streaming with fastAPI. I have two topics

I want if the logic fails in main_topic it should call retry_topic and if that fails so there should be max 3 retries that it should do. I’ve tried using sink in faust streaming what it does is that it yield result from my main topic to retry_topic but I’m still not able to limit it to 3 retries.

Is there a way to do that in faust/Kafka streaming I know that celery has this feature?

There’s StackOverflow URL feel free to answer there as well.. https://stackoverflow.com/questions/74360650/faust-streaming-retry-topic-mechanism

I know it's not an appropriate channel to ask this here, but I couldn't find the slack URL working on the faust website.

wbarnha commented 1 year ago

Sorry I didn't see this until now, try filing an issue with us in https://github.com/faust-streaming/faust?

I'm also currently reviewing a potential solution for this.