search

redpanda-data / connect

Fancy stream processing made operationally mundane
https://docs.redpanda.com/redpanda-connect/about/
8.14k stars 840 forks source link

Iceberg support #2624

Open pixie79 opened 5 months ago

pixie79 commented 5 months ago

Are there plans for an Iceberg output with AWS Glue Catalog support? (Or multiple iceberg catalogs support)

This would be useful for tools like Athena to then be able to query micro delay realtime data.

hendoxc commented 5 months ago

Agree. A that a large reason why I'd still use Kafka Connect is for the Iceberg Sink Connector. Given that iceberg has become the industry standard for many orgs storing data in s3/gcs/azure.