apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.8k stars 978 forks source link

[Proposal][Refactor] Streampark feature decoupling and microservicing based on grcp #1513

Open MonsterChenzhuo opened 1 year ago

MonsterChenzhuo commented 1 year ago

Search before asking

Description

1. 背景

未来streampark的功能模块会不断增多,对于项目的维护,和开发都带来了巨大的挑战。通过功能组件的解偶,可以更加友好的降低开发难度,减少功能迭代间的代码污染,增加系稳定性。

2. Proposal

基于grcp进行streampark功能解藕和微服务化

3.模块划分

1.catalog-元数据、交互式查询服务 2.appmanager-系统管理服务 3.log-日志&指标服务 3.autopilot-flink实时任务动态调优服务 4.storage-存储服务

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

Whojohn commented 1 year ago

I think Restful is more humanable than grpc. In my mind performanace can improve by mulit instance if we support microservices. (Not all moudule need microservices) .

wolfboys commented 1 year ago

You can make a meeting to discuss this.