StarRocks / starrocks-connector-for-apache-flink

Apache License 2.0
189 stars 152 forks source link

[BugFix] Resolve Delete Semantics Data Loss in Flink SQL for StarRocks 3.1 #365

Open andystenhe opened 3 months ago

andystenhe commented 3 months ago

In the 3.1 storage-computation separated version, using the INSERT INTO statement in Flink SQL will lose data with Delete semantics.

What type of PR is this:

Which issues of this PR fixes :

Fixes #364

Problem Summary(Required) :

In the storage-computation separated version, the primary key information is not stored in the information_schema.COLUMNS table, causing the Flink connector to fail to detect the primary key and assume that the StarRocks table does not support writing Flink delete rowkind data.

Solution: Determine whether to support delete semantics based on the primary key declaration in the Flink table.

Checklist:

CLAassistant commented 3 months ago

CLA assistant check
All committers have signed the CLA.