search

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.2k stars 3.58k forks source link

[DISCUSS] proposal: APISIX support Pulsar service plugin #13158

Closed wang-yeliang closed 1 year ago

wang-yeliang commented 2 years ago

Hi, community,

My name is Yeliang Wang, and I am Apache APISIX Committer.

At present, Apache APISIX supports Kafka in real-time log processing (https://apisix.apache.org/docs/apisix/plugins/kafka-logger/ ) ,and RocketMQ has also submitted PR to support APISIX (https://github.com/apache/apisix/pull/5653)

but, in many enterprises I met, Apache Pulsar is used in both transaction and log scenarios.

As a distributed message middleware, Apache Pulsar has a very important position and a large user base in China, It also has a good cooperative relationship with APISIX community.

Therefore, I suggest that Pulsar contribute relevant plug-ins to APISIX, which can not only meet the diversified needs of users, so enrich the surrounding ecology of Pulsar.

This is my suggestion. Developers are welcome.

Thanks.

ericsyh commented 2 years ago

I also take some attention on this point and I think the current challenge for Pulsar is lacking of the Lua client library like lua-resty-kafka for Kafka and lua-resty-rocketmq for RocketMQ.

Maybe another solution is to leverage the Plugin Runner in APISIX which supports Java/Go/Python and Pulsar has related client libraries for all of them.

wang-yeliang commented 2 years ago

Maybe I missed the information before.

Who developed lua-resty-kafka https://github.com/doujiang24/lua-resty-kafka for Kafka?

Eric Shen @.***> 于2021年12月8日周三 20:53写道：

I also take some attention on this point and I think the current challenge for Pulsar is lacking of the Lua client library unlike lua-resty-kafka https://github.com/doujiang24/lua-resty-kafka for Kafka and lua-resty-rocketmq https://github.com/yuz10/lua-resty-rocketmq for RocketMQ.

Maybe another solution is to leverage the Plugin Runner https://apisix.apache.org/docs/java-plugin-runner/development/ in APISIX which supports Java/Go/Python and Pulsar has related client libraries for all of them.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/apache/pulsar/issues/13158#issuecomment-988789511, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEXXFGOF23JPETCYZRQ5WS3UP5ILHANCNFSM5JQFXVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

ericsyh commented 2 years ago

After a brief discuss with @wang-yeliang and @jiazhai, it'll be better to develop the APISIX plugin with native Lua cause of the performance and usability than using the Plugin Runner.

So this issue will be breakdown into:

Any other thoughts are all open to discuss and really welcome anyone wants to help on this issue.

wang-yeliang commented 2 years ago

We are looking forward to the development of pulsar community friends Lua Pulsar Library and APISIX Pulsar Plugin.

Let's enrich the surrounding ecology of Aapche Pulsar.

Eric Shen @.***> 于2021年12月15日周三 10:36写道：

After a brief discuss with @wang-yeliang https://github.com/wang-yeliang and @jiazhai https://github.com/jiazhai, it'll be better to develop the APISIX plugin with native Lua cause of the performance and usability than using the Plugin Runner https://apisix.apache.org/docs/java-plugin-runner/development/.

So this issue will be breakdown into:

Any other thoughts are all open to discuss and really welcome anyone wants to help on this issue.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/apache/pulsar/issues/13158#issuecomment-994235366, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEXXFGKZJN34KI4HLULZ5LLUQ75K3ANCNFSM5JQFXVQQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.