support load data from starrocks table by specific condition

StarRocks / starrocks-connector-for-apache-flink

Apache License 2.0

195 stars 160 forks source link

support load data from starrocks table by specific condition #345

Open billowsoft opened 8 months ago

billowsoft commented 8 months ago

https://github.com/StarRocks/starrocks-connector-for-apache-flink/blob/08de67ad0f5c3cd9fbc3707466df6c642dfee7e7/src/main/java/com/starrocks/connector/flink/table/source/StarRocksDynamicLookupFunction.java#L99

Current implementation is loading all the data of the table which will cause OOM while the the data volume is too big, suggest can support load data by specific condition, just like org.apache.flink.connector.jdbc.table.JdbcLookupFunction

jaogoy commented 7 months ago

@billowsoft You mean it's no way to specify the condition? cc @banmoy