sky-uk / kfp-operator

https://sky-uk.github.io/kfp-operator
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

Event Processor (remove argo events from provider) (Step 4) #359

Open grahamia opened 2 months ago

grahamia commented 2 months ago

Overview

To simplify the eventing process within the provider we can drop the event source server/eventsource/sensor complexity and have one simpler single deployment which carries out the same functionality. The beauty of this is that now there is no dependency on argo events within the provider.

Technical Details

In this step the deployment of the new component can stay within the provider helm chart, in future card the deployment will be made part of the controller itself with no need for provider helm anymore.

The DataWrapper in the KFP Operator webhook can be removed at this point as no argo events wrapping needed.

Current Architecture

image

After Architecture

image

Acceptance Criteria

Eventing feedback should function as currently with no change Testing should be carried out to ensure that same retry logic on failure exists and at least once consistency is maintained.