search

appsmithorg / appsmith

Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.
https://www.appsmith.com
Apache License 2.0
34.64k stars 3.74k forks source link

[Feature]: Kafka support #10289

Open arbfay opened 2 years ago

arbfay commented 2 years ago

Is there an existing issue for this?

Summary

Read messages from Kafka topics and create messages, using a predefined schema (retrieved from the Schema Registry, or added manually, or none).

Why should this be worked on?

Event-based architectures are becoming more and more important as they are adopted by industries where events drive the business (finance, logistics, etc). Kafka (and alternatives that implement its API, such as Redpanda) is a major event streaming platform that is used as a data source/sink by a growing number of applications. It would benefit Appsmith to include Kafka to expand its use cases.

Front logo Front conversations

Nikhil-Nandagopal commented 2 years ago

@arbfay thank you for the feature request! I believe this would require us to implement #1950

gonchik commented 1 year ago

Any plans for the implementation? it will be very useful for our landscape :)

UMinky commented 1 year ago

Is there something new here? Is this being worked on?

huckpdx commented 2 months ago

this would be a great addition to appsmith. I'm building systems using both kafka and appsmith. bouncing data through a DB is awkward.

does anyone have any good workarounds?

Nikhil-Nandagopal commented 2 months ago

@huckpdx have you tried using the rest API for Kafka along with either a polling mechanism or websockets?