apache / hop

Hop Orchestration Platform
https://hop.apache.org/
Apache License 2.0
890 stars 328 forks source link

[Feature Request]: Additional web services #3194

Open avizingdbronson opened 10 months ago

avizingdbronson commented 10 months ago

What would you like to happen?

Similar to the methods described on this page:

https://hop.apache.org//manual/latest/hop-server/rest-api.html

It would be helpful to have some additional methods to make managing clusters of hop servers running behind a load balancer easier to manage. One method would be to have the server stop accepting new requests (but not interfere with in-process events. This would allow the server/container to finish it's work gracefully before being terminated. Another would be helpful to know if processes are still actively working on payloads. This would be a good health check for the management process to know that it is safe to terminate the server.

Issue Priority

Priority: 3

Issue Component

Component: Containers, Component: Hop Server

mattcasters commented 7 months ago

Surely there must be other products out there to do web traffic load balancing? As for managing clusters of Hop instances, can I suggest a container management system?

avizingdbronson commented 1 month ago

This feature isn't about managing the cluster (as in adding or removing nodes from a cluster). This is about communication with the load balancing process. For example, If 2 nodes are running and both have available capacity, the load balancer should want to retire one of those instances, but how does it know that the instance is actually idle? Having the ability to tell hop to stop accepting new work would be helpful (in addition to an orchestration approach to stop submitting new events to a node that is expected to be retired).