search

marcosschroh / python-schema-registry-client

Python Rest Client to interact against Schema Registry confluent server
https://marcosschroh.github.io/python-schema-registry-client
MIT License
170 stars 55 forks source link

Need a solution for Azure Event Hubs for Apache Kafka schema registry #98

Open meherpravin opened 3 years ago

meherpravin commented 3 years ago

Faust-streaming application should access Azure Event Hubs for Apache Kafka schema registry.

Describe the solution you'd like I would like to get SchemaRegistryClient for azure event hubs based on azure connection parameters.

marcosschroh commented 3 years ago

Hi @meherpravin

Which are the azure connection parameters? Could you describe why you can not use the current implementation to connect to the Schema Registry Server?

meherpravin commented 3 years ago

Hi @marcosschroh , We need to set additional connection parameters like schema_group, connection string or credentials. Kindly let me know If we have another solution to connect azure hubs schema registry in faust-streaming application.

I am trying to implement faust app as below.

SCHEMA_GROUP = << GROUP NAME OF THE SCHEMA >> EVENTHUB_NAMESPACE = << Namespace >> SCHEMA_REGISTRY_URL = "{EVENTHUB_NAMESPACE}.servicebus.windows.net:9093" SASL_USERNAME = "$ConnectionString" SASL_PASSWORD = f"Endpoint=sb://{EVENTHUB_NAMESPACE}.servicebus.windows.net/;SharedAccessKeyName={...};SharedAccessKey={...}"

app = faust.App( broker=f"kafka://{EVENTHUB_NAMESPACE}.servicebus.windows.net:9093", broker_credentials=faust.SASLCredentials( username=SASL_USERNAME, password=SASL_PASSWORD, ssl_context=ssl.create_default_context() ), )

marcosschroh commented 3 years ago

Hi @meherpravin,

I am researching and adding what you need like schema_group means that we need to patch faust. I think this should be an open issue on faust side.

Did you have any progress ?