Open bohdantan opened 3 years ago
I've seen this too. I've had to kill -9
the process pretty consistently.
@bohdantan - Do you have any updates on this by any chance ? ... Also seeing the same behavior.
@lachuta I do not have any updates. We have patched faust.transport.drivers.aiokafka.AIOKafkaConsumerThread.commit
to write error to logs and return if self.method_queue.should_stop:
Actually this repository is not updated for more than 2 years. There is a fork https://github.com/faust-streaming/faust but I am not sure this bug is fixed there
@bohdantan - is your patch available anywhere ? Did it make it to a faust version ?. These are the version we are using:
Checklist
master
branch of Faust.Steps to reproduce
pip install git+https://github.com/robinhood/faust@b6ebdd955c1de5ceed81f53ade76b4b04561151e
example.py
import faust
app = faust.App( 'test-app', broker='kafka://localhost:9092', value_serializer='raw', )
test_topic = app.topic('test')
@app.agent(test_topic) async def process(stream): async for msg in stream: print(f'Start processing {msg}') await asyncio.sleep(30) await app.crash(RuntimeError('CRASH')) print(f'Finish processing {msg}')
@app.task(on_leader=True) async def on_started(): print('Add messages') for i in range(5): msg = f'Message i={i}' await test_topic.send(key=msg, value=msg)
Versions