search

allwefantasy / spark-binlog

A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
Apache License 2.0
154 stars 54 forks source link

spark-binlog upgrade to spark 3.1.x #34

Open AirToSupply opened 2 years ago

AirToSupply commented 2 years ago

Hi，William;

Could you have any plans to upgrade spark 3.1.x, we are using spark 3.1.x to explore spark cdc

thank you，good luck!

AirToSupply commented 2 years ago

Hi, William: The issue of pull request (https://github.com/allwefantasy/spark-binlog/issues/34) has been done! We have tested it on the production environment and can work. The environment is as follows： Scala：2.12.8 Spark：3.1.1 Hadoop：2.10.1