Jeffail
commented
2 years ago Hey @skyoct, there's definitely potential for a sort of "manager" API for managing a cluster of benthos instances. However, it's never really been a priority as Benthos itself is stateless so it's fairly easy to use kubernetes or alternatives rather than a bespoke tool. I'll mark this as a cool idea but it's unlikely we'll tackle this any time soon without commercial push.
First of all, thank you for developing benthos for our use
My usage scenario is to synchronize Kafka data to HDFS so that hive can use it. Each hive table has a benthos task. I can't monitor all tasks under a large number of tasks. I hope to have a registration center for all benthos tasks, so that I can easily know the list of all my tasks and their addresses.