SwissDataScienceCenter / amalthea

A kubernetes operator for spawning and exposing interactive user session servers.
Apache License 2.0
14 stars 4 forks source link

Generate and then save auditlogs to S3 #635

Open sgaist opened 1 month ago

sgaist commented 1 month ago

The implementation of Amalthea V1 provides an option to export logs from the operator to an S3 bucket.

This ticket tracks the port / re-implementation of this feature.

sgaist commented 1 month ago

@olevski @rokroskar

I was taking a look at the original implementation and the following question came to my mind: should that really be the responsibility of Amalthea to export it's own logs ?

Checking the k8s logging documentation, I was wondering if this should not be handled by a dedicated sidecar such as fluentd which provides a dedicated output for s3

olevski commented 2 weeks ago

@sgaist it would be nice if we can pull this off. The problem is that the audit logs are not just a subset of the plain application logs of the operator. But this should be a problem we can solve. I have never heard of fluentd but it seems like what we need.