confluentinc / confluent-kafka-python

Confluent's Kafka Python Client
http://docs.confluent.io/current/clients/confluent-kafka-python
Other
3.72k stars 882 forks source link

Initializing producer throws segfault #1728

Open asas1235066 opened 2 months ago

asas1235066 commented 2 months ago

Description

Confluent-kafka-python will exit with an error when running in the twisted framework.

I found that using version 1.9.2 can run in the twisted framework, but versions after 2.0.2 will throw an exception.

The stack information is as follows: 17129008166569

Can you help me find the cause and suggest a fix?

How to reproduce

from confluent_kafka import Producer
from twisted.internet import reactor
from twisted.internet.threads import deferToThread

def instantiate_producer():
    producer_config = {
        'bootstrap.servers': ['127.0.0.1:9092'],
    }
    Producer(producer_config)

def handle_result(*args):
    reactor.stop()

d = deferToThread(instantiate_producer)
d.addCallback(handle_result)
reactor.run()

Dependent environment is as follows: os Centos7.6 Python 3.7.4 Twisted 19.7.0 confluent-kafka 2.3.0 Kafka 2.4.1

Checklist

Please provide the following information: