Closed wang-yeliang closed 1 year ago
I also take some attention on this point and I think the current challenge for Pulsar is lacking of the Lua client library like lua-resty-kafka for Kafka and lua-resty-rocketmq for RocketMQ.
Maybe another solution is to leverage the Plugin Runner in APISIX which supports Java/Go/Python and Pulsar has related client libraries for all of them.
Maybe I missed the information before.
Who developed lua-resty-kafka https://github.com/doujiang24/lua-resty-kafka for Kafka?
Eric Shen @.***> 于2021年12月8日周三 20:53写道:
I also take some attention on this point and I think the current challenge for Pulsar is lacking of the Lua client library unlike lua-resty-kafka https://github.com/doujiang24/lua-resty-kafka for Kafka and lua-resty-rocketmq https://github.com/yuz10/lua-resty-rocketmq for RocketMQ.
Maybe another solution is to leverage the Plugin Runner https://apisix.apache.org/docs/java-plugin-runner/development/ in APISIX which supports Java/Go/Python and Pulsar has related client libraries for all of them.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/apache/pulsar/issues/13158#issuecomment-988789511, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEXXFGOF23JPETCYZRQ5WS3UP5ILHANCNFSM5JQFXVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
After a brief discuss with @wang-yeliang and @jiazhai, it'll be better to develop the APISIX plugin with native Lua cause of the performance and usability than using the Plugin Runner.
So this issue will be breakdown into:
Any other thoughts are all open to discuss and really welcome anyone wants to help on this issue.
We are looking forward to the development of pulsar community friends Lua Pulsar Library and APISIX Pulsar Plugin.
Let's enrich the surrounding ecology of Aapche Pulsar.
Eric Shen @.***> 于2021年12月15日周三 10:36写道:
After a brief discuss with @wang-yeliang https://github.com/wang-yeliang and @jiazhai https://github.com/jiazhai, it'll be better to develop the APISIX plugin with native Lua cause of the performance and usability than using the Plugin Runner https://apisix.apache.org/docs/java-plugin-runner/development/.
So this issue will be breakdown into:
- Lua Pulsar Library: like lua-resty-kafka https://github.com/doujiang24/lua-resty-kafka and lua-resty-rocketmq https://github.com/yuz10/lua-resty-rocketmq.
- APISIX Pulsar Plugin: like kafka-logger https://github.com/apache/apisix/blob/master/apisix/plugins/kafka-logger.lua and rocketmq-logger https://github.com/apache/apisix/blob/master/apisix/plugins/rocketmq-logger.lua .
Any other thoughts are all open to discuss and really welcome anyone wants to help on this issue.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/apache/pulsar/issues/13158#issuecomment-994235366, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEXXFGKZJN34KI4HLULZ5LLUQ75K3ANCNFSM5JQFXVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
The issue had no activity for 30 days, mark with Stale label.
The issue had no activity for 30 days, mark with Stale label.
Hi, community,
My name is Yeliang Wang, and I am Apache APISIX Committer.
At present, Apache APISIX supports Kafka in real-time log processing (https://apisix.apache.org/docs/apisix/plugins/kafka-logger/ ) ,and RocketMQ has also submitted PR to support APISIX (https://github.com/apache/apisix/pull/5653)
but, in many enterprises I met, Apache Pulsar is used in both transaction and log scenarios.
As a distributed message middleware, Apache Pulsar has a very important position and a large user base in China, It also has a good cooperative relationship with APISIX community.
Therefore, I suggest that Pulsar contribute relevant plug-ins to APISIX, which can not only meet the diversified needs of users, so enrich the surrounding ecology of Pulsar.
This is my suggestion. Developers are welcome.
Thanks.