Add the field level cache to reduce duplicate data entry

apache / rocketmq-streams

Apache rocketmq

https://rocketmq.apache.org/

Apache License 2.0

171 stars 82 forks source link

Add the field level cache to reduce duplicate data entry #60

Closed j-ching closed 3 years ago

j-ching commented 3 years ago

When the data source has a large amount of duplicate data for certain fields and these duplicate records are not needed for subsequent operations, we want to filter the data at the source of the real-time task