sky-uk / kfp-operator

https://sky-uk.github.io/kfp-operator
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

Create EventSource Webhook to publish Run Completion Events to eventbus #363

Closed aidandunlop closed 2 months ago

aidandunlop commented 2 months ago

Closes https://github.com/sky-uk/kfp-operator/issues/356.

As per the ticket above, we've created a new webhook-based argo EventSource, which along with a new Sensor will publish events to the NATS EventBus. The current Run Completion Event Sensor (which is per-Provider) now sends the event via HTTP through the webhook.

Tested in Vertex AI and Kubeflow Pipelines.

Architecture after this change: image