DataLinkDC / dinky

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
http://www.dinky.org.cn
Apache License 2.0
2.93k stars 1.07k forks source link

[Improvement] use sqllite or h2 or dinky server database to cache db data and mertrics data #3201

Open Zzm0809 opened 4 months ago

Zzm0809 commented 4 months ago

Search before asking

Description

en:

Currently, paimon is used as a cache medium for data source information and monitoring data. However, paimon's strong dependence on hadoop leads to a series of dependency and data problems that need to be optimized.

cn:

当前使用 paimon 作为数据源信息和监控数据的缓存介质和监控数据存储介质,但是 paimon 强依赖 hadoop 导致一系列依赖和数据问题, 需要优化,且目前会导致内存泄露 方案一: 使用 spi 方式进行扩展新增类型为 sqllite 或者 h2 的缓存介质, 默认优先使用 dinky 服务的数据库存储介质 方案 二: 直接使用 sqllite 或者 h2 替换掉 paimon

Are you willing to submit a PR?

Code of Conduct

github-actions[bot] commented 2 months ago

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

github-actions[bot] commented 1 week ago

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。