I used [kafka-connect-iceberg-sink] to ingest data from the Kafka broker. This is my topic:
I saved data from Kafka into Minio with Iceberg format. After, I tried to use Spark and Trino to compaction small data files but it took me a lot of time and failed
Can anybody give me some recommendations to resolve this problem???
I used [kafka-connect-iceberg-sink] to ingest data from the Kafka broker. This is my topic: