apache / doris-kafka-connector

Kafka Connector for Apache Doris

https://doris.apache.org

Apache License 2.0

10 stars 9 forks source link

Release Note 1.1.0 #39

Open JNSimba opened 2 months ago

JNSimba commented 2 months ago

Features & Improvements

Support kafka type converter #12
Support debezium table schema changes #14
The change basis of table schema is changed to parse data column field
add cache for schema change fetch doris table by #19
Improve the length of generated stream load label #18
schema.evolution adds debezium prefix #24
Add a check for column existence when adding a new column #20
Support reading protobuf serialized data #23
Optimize to determine whether table in doris exists #26
Support stream load configuration TwoPhaseCommit #27
Support importing MySQL geographic data types and PostgreSQL array data types
Optimize and delete some redundant code #30
Implement DorisAvroConverter to support parsing schema from avro avsc file path
Add kafka to doris container test case #33
Improve the unit test case of DorisWriter #34
support stream load with group commit mode #35

Bug

Fixed the problem that the kafka topic contained dot characters
Fix maven shade relocate error #8
Fix using debezium as kafka upstream data source #11
Fix failed test cases and optimize pom.xml #13
Fix mysql time type parsing error #15
Fix some bugs in commit offset to kafka, intercepting non-schema changes, and intercepting truncate table #16
Fix Enum data type mapping null pointer #21
Fix DateTimeUtils, SchemaUtils referenced packages from debezium-connector-jdbc
Fix npe exception caused by closing jmx #31
Fix the E2E test stream load data is not sink to doris #37

Thanks

@DongLiang-0
@vinlee19