ailtonguitar commented 10 months ago

KafkaFlow Component support on Aspire

What is and its benefits

KafkaFlow is a library developed and maintained by Farfetch The library was created on top of the Confluent Kafka client, to be a simple and easy way of installing, using, maintaining, and configuring Kafka. The community widely uses KafkaFlow, as can be seen by the number of downloads in the KafkaFlow Nuget (over 1M), adding non-existent features and extending several functionalities, among the features are:

Multi-threaded consumer with message order guarantee;
Middleware support for producing and consuming messages;
Support topics with different message types using different typed handlers;
Global Events Subscription for message production and consumption;
OpenTelemetry Instrumentation for traces and baggage signals;
Graceful shutdown (wait to finish processing to shutdown);
Dynamic Workers Configuration;
Admin Web API that allows pause, resume, and restart consumers, change workers count, and rewind offsets, all at runtime;
Dashboard UI that allows the visualization of relevant information about all consumers and managing them; and The full list of features can be found here - https://farfetch.github.io/kafkaflow/docs/#features

Goal

Provide a component for KafkaFlow for those who will use Aspire.

davidfowl commented 9 months ago

There's already work happening here for kafka (https://github.com/dotnet/aspire/pull/951).

ailtonguitar commented 8 months ago

There's already work happening here for kafka (#951).

Hi @davidfowl I've seen this PR but it is different, the idea is to add kafkaflow component as an alternative to simplify the adoption of kafka. Similar to Cosmos and EntityFramework.Cosmos

ailtonguitar commented 6 months ago

Hello! Can I open a PR with a contribution to add this component?

@eerhardt @davidfowl

eerhardt commented 6 months ago

Can I open a PR with a contribution to add this component?

@ailtonguitar - we are prioritizing stabilizing for Aspire 8.0.0 for the next month or two. A PR might not receive much attention until after 8.0.0 has shipped as the team is focusing on the current feature set.

gradovenko commented 2 weeks ago

Hi. Any updates on this feature?

dotnet / aspire