apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.44k stars 959 forks source link

[Feature] Support guava cache in CacheManager #4388

Closed FangYongs closed 3 weeks ago

FangYongs commented 4 weeks ago

Search before asking

Motivation

Currently, the CacheManager uses Caffeine 2 to manage cached data. However, Caffeine 2 has an issue when evicting data using the LRU (Least Recently Used) strategy, which causes newly added data to be evicted. Although Caffeine 3 has already fixed this issue, it only supports Java 11 and above versions. Since quite a number of businesses and systems are still using Java 8, we'd like to support guava Cache in CacheManager.

Related to #4096 and #4141

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

FangYongs commented 4 weeks ago

The discussion about java8 and java11 is in PR https://github.com/apache/paimon/pull/4278 cc @JingsongLi @Aitozi