Closed hgalytoby closed 2 months ago
Do you need the Faust application to create the topic? Can you try to add the topic manually with the Kafka topic scripts and see if that helps?
Usually I don't need faust to create a topic, usually faust just creates the leader topic for me.
I know there are other ways to create topics, it's just a matter of me finding out about it and letting it be known!
I have an issue with my applications where if I use Faust to create the topics it often results in a topic not being created (something about topic can't be used while being created) and then the error message ignoring missing topic:
To get around this, I manually create the topics before hand using the kafka_topics.sh (or .bat if using windows) that's part of your kafka download and found in the bin directory.
For me, when ever I start my application I first run:
kafka-topics.sh --create --if-not-exists --topic <topic name> --bootstrap-server=<address> --partitions=<partitions>
replacing topic name, address, and partitions with the appropriate values.
The --if-not-exists argument will only create the topic if it doesn't already exist.
I'm seeing the same issue with the combination of faust 0.11.0 and aiokafka 0.10.0. Forcing aiokafka==0.10.0 fixes the issue.
Added a PR for this https://github.com/faust-streaming/faust/pull/631, can someone have a look?
poetry add faust-stream
error
AttributeError: 'CreateTopicsRequest_v1' object has no attribute 'build_request_header'
No problems with aiokafka 0.10.0