[KEPLER-MISSION] OpenConnect Runtime Optimization

[RongtongJin]

OpenMessaging is a cloud native, vendor-neutral open specification for distributed messaging. By following OpenMessaging Connect API instead of a Message-Queue specific API, developers avoid repetitive work in building connector plugins for different message queues. OpenMessaging also provides a runtime specification which provides cluster management, scheduling, resource allocation and load-balancing functionality for OpenMessaging Connect. RocketMQ Runtime implements OpenMessaging Runtime.

This Topic requires you to optimize RocketMQ Connect Runtime, including

• Optimize the file connector in Connect Runtime, provide quick-start script.
• Complete the development of the Cassandra connector and optimize the runtime during the development.
• Optimize the configuration of the connect runtime clusters and the synchronization mechanism of the sites, Solve the issue that the startup speed of newly added workers is slow.
• Optimize Connect Runtime configuration information storage format to make it easier to manage.
• Optimize the connector loading mechanism, increase the configuration to determine the startup sequence of the connector and whether to start.
• Optimize the restful interface, add full start/stop and life cycle management for connector/task level
• Complete Connect Runtime docker image packaging.
• Improve the documentation.
• Other ease-of-use optimization.

OpenMessaging是云原生、厂商中立的分布式消息开放规范的集合。通过遵循OpenMessaging Connect API而不是特殊的Message Queue的API，开发人员可以避免为不同的消息队列构建connector插件。OpenMessaging还提供了一个OpenMessaging Runtime，该规范为OpenMessaging Connect提供了群集管理，调度，资源分配和负载平衡功能。 RocketMQ Runtime 实现 OpenMessaging Runtime。

本题目希望你能优化Connect Runtime，包括

• 优化Connect Runtime中的file connector，提供一键运行quick start脚本。
• 完成Cassandra connector的开发，在开发过程中优化Runtime。
• 优化Connect Runtime集群间配置、位点同步机制，解决新加入worker启动速度过慢的问题。
• 优化Connect Runtime配置信息存储格式，使其更加容易管理。
• 优化connector加载机制，增加配置决定connector的启动顺序以及是否启动。
• 优化restful接口，提升易用性，增加全量启动停止以及针对connector/task层级的生命周期管理。
• 完成Connect Runtime docker镜像打包。
• 完善文档。
• 其他易用性的优化提升。

[Dreaouth]

Hi，@RongtongJin I'm interested in this project for asoc，do you have some guideline tasks or suggestions to start with this project?

[RongtongJin]

Hi @Dreaouth Welcome to the RocketMQ community.  I suggest you read some documents about Open Connect https://rocketmq-1.gitbook.io/rocketmq-connector/ https://github.com/apache/rocketmq-externals/tree/master/rocketmq-connect https://github.com/openmessaging/openmessaging-connect https://github.com/openmessaging/openmessaging-connect-runtime If you want to complete this project, you also need a deeper understanding of the source code. Looking forward to your participation.

[Fuyun791]

@RongtongJin I participated in the issue for the first time and wanted to ask two questions. The first question, I saw that everyone uses English. Do I need to communicate in English as much as possible? Another question is that there is already someone interested in this project, can I still participate in this project

[RongtongJin]

Hi @Fuyun791 , it would be better to communicate in English. In addition, so far we have not received a specific proposal for this project, and there is no limit to the number of students that can participate in each project. So looking forward to your participation.

[Dreaouth]

@RongtongJin Thank you for your suggestions！I'm finishing my proposal for this issue by understanding the source code and documents. I will submit my applications before the deadline.

[RongtongJin]

Hi, @Dreaouth @Fuyun791, ASoC's registration deadline(06.30) is approaching. If you want to participate, don't forget to submit your proposal. We look forward to your participation

[Dreaouth]

@RongtongJin I have finished my proposal. Do I need to send it to you first and you can have a look and provide some advice? So that I can have a more specific requirement and modify my proposal.

[Dreaouth]

Hi, @RongtongJin I have submit my proposal. Did you get it? If you have any questions with my proposal, please contact me via the email in the proposal. Thank you very much !