search

apache / incubator-heron

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter
https://heron.apache.org/
Apache License 2.0
3.65k stars 599 forks source link

Class ShellBolt not supported? #1024

Open severun opened 8 years ago

severun commented 8 years ago

Hey all,

I'm trying to upgrade an existing storm topology to Heron, but I'm having a problem. In our Storm bolt we use the following code to execute a c++ program: import backtype.storm.task.ShellBolt; public class MyBolt extends ShellBolt implements IRichBolt public MyBolt(int modelid) { super("sh", "runbinary.sh"); }

However, when I try to compile the new bolt for Heron using maven, I get the following error message:

cannot find symbol [ERROR] symbol: class ShellBolt [ERROR] location: package backtype.storm.task

I tried searching in the Heron API documentation for the ShellBolt but I cannot find it. It this bolt replaced by some other class? And if so, how do I replace this bolt in Heron?

nlu90 commented 8 years ago

@severun Currently, heron doesn't support ShellBolt.

severun commented 8 years ago

@nlu90 Is there an alternative way to implement c++ calls in a bolt? Or does this mean Heron is no longer a viable framework for us? We can't really port all our code to java just to support the framework .

kramasamy commented 8 years ago

@severun - we are working on seeing how much effort to add shell bolt. Will keep you posted.

kramasamy commented 8 years ago

@caofangkun - can you please help with this?

caofangkun commented 8 years ago

@kramasamy Ok, I'll keep track :)

kramasamy commented 8 years ago

@caofangkun - any update on this?

severun commented 7 years ago

Is there any update on this yet? I noticed that the milestone has been updated/rescheduled quite often but cannot find any progress description regarding this feature request.

objmagic commented 7 years ago

@severun The person outside Twitter (@caofangkun) who volunteered to work on this is not active, and internally we don't have people working on it.

kramasamy commented 7 years ago

@severun - We are bit resource crunched on this. Also there are some folks who are doing native C++ topologies. Perhaps that might satisfy your need - not sure.

kramasamy commented 7 years ago

@severun - furthermore, the shell bolt implementation in Storm is bit convoluted. We are rethinking this design and see how we can support it cleanly.