rcenvironment / rce

Distributed, workflow-driven integration environment
https://rcenvironment.de/
51 stars 16 forks source link

Allow ra-admin to publish workflows on a different instance #14

Open ArneBachmann opened 6 years ago

ArneBachmann commented 6 years ago

If I open just one RCE instance on the network for remote access, but want to publish a tool on a different RCE behind it, there is currently no option for that. I don´t want to open (and manage) a SSH port for each instance that I potentially want to publish a workflow on.

I.e. sysmon has both options already, local and remote.

rmischke-dlr commented 6 years ago

Hi Arne,

the Remote Access feature is going to see major improvements in RCE 9.x and 10.x (according to our current roadmap). One of these planned improvements is that published workflows are going to behave just like other published components. Once this is implemented, the standard component visibility and forwarding rules will apply to them as well. This change is currently scheduled for RCE 10.

In other words, the current Remote Access "publish workflow" concept will be redundant. Instead of publishing a workflow specifically for SSH, you publish the workflow as a common component, and then authorize this component for access in the local network and/or via SSH.

Would this cover your use case?

ArneBachmann commented 6 years ago

Would it be possible to open an SSH port on a node facing the outside network, but have the tool or workflow published on another node connected to this SSH server? I think that is the original question.

rmischke-dlr commented 2 years ago

Status of related features/concepts:

The "Remote Access" feature is deprecated and is planned to be superseded by the (currently experimental) "Uplink" feature. The latter provides a much better and more extensible design. Therefore, any related ideas will be reviewed against Uplink, not RA anymore. This also includes "Workflow as Component", which is the generalized concept replacing RA's "publish workflow" feaure.

Roadmap status:

The roadmap is not finalized yet, but it might involve RA being removed completely in 11.0.0, and Uplink promoted to non-experimental status.

rmischke-dlr commented 2 years ago

Status update as of RCE 10.3.1:

Regarding your specific setup, it seems that this should be fully covered by the combination of the "Uplink" and "Workflow as Component" features. In Uplink, the node providing the SSH access port (currently only one port supported) for internal and external access is completely independent of tool publishing -- this was conceptually different in Remote Access. So a typical setup that should address your setup would be these three example nodes:

(Of course, if you don't need SSH/Uplink to realize cross-organizational tool exchange, you can simply use "Workflow as Component" in an internal RCE network and be done. This is in case you were only using Remote Access as a preliminary way of wrapping workflows into components.)

Does this cover your use case?

ArneBachmannDLR commented 2 years ago

I think I understand your suggested solution. My original idea, however, was different. I have several RCE profiles running on the same node, but didn't want to open multiple SSH ports to deploy tools to them.

My idea was that the relay node is able to forward my tool to publish automatically to the target node via a command on its only open SSH port (I publish via the relay SSH to any node connected to it).

But nevermind, I don't think it's that critical and we'll find different ways of managing projects, once our server will finally be running.