-
Hello community,
i'm using Hudi to change data capture with spark structured streaming + kafka + debezium , my jobs works well, but since few days i got some errors on some of my streams : java.la…
-
[INFO] 2020-09-24 17:17:54.245 - [taskAppId=TASK-6-21-23]:[121] - -> Connecting to jdbc:hive2://gdlt-b-master01.cnbdcu.com:2181,gdlt-b-master02.cnbdcu.com:2181,gdlt-b-master03.cnbdcu.com:2181,gdlt-b…
-
I've stumbled across the article using DataFlow with Debeizum for CDC on MySQL. Would it be possible to also support Postgres on CloudSQL?
I've evaluated Postgres with Debezium directly but annoyin…
-
**Describe the problem you faced**
I used Flink to update data in realtime, and used spark to read data, it throws an error `com.esotericsoftware.kryo.KryoException: Encountered unregistered class …
-
## Bug
### Describe the problem
When configure spark using [setup-configuration-s3-multi-cluster](https://docs.delta.io/latest/delta-storage.html#-setup-configuration-s3-multi-cluster
) In exampl…
-
**Describe the problem you faced**
We are unable to make async compaction work on the MOR table using spark streaming.
**Expected behavior**
As per the [documentation](https://hudi.apache.o…
-
byzer version: byzer-lang-2.4.3-2.3.0.1
spark version: 2.11-2.4.7.7.1.7.0-551（Cloudera CDH）
scala version: 2.11.12
-
### Describe the bug
I'm trying to retrieve all the tables that contains a specific set of lf-tags.
I first tried to use boto3 in an ETL job with that kind of request:
 environment with Apache Hudi?
We are creating our Datalake, stored on AWS S3, by running a Spark structured streaming applicatio…
ghost updated
2 years ago
-
I try to create table and sysn to hive. However its show CreateHoodieTableCommand.orgsetter$nodePatterns_$eq(Lscala/collection/Seq;)V is abstract. I use hudi 0.11 + spark 3.2.1.
Environment Descri…