terascope / teraslice

Scalable data processing pipelines in JavaScript
https://terascope.github.io/teraslice/
Apache License 2.0
50 stars 13 forks source link

k8s-env export logs on pod exit #3675

Open busma13 opened 4 days ago

busma13 commented 4 days ago

It would be nice to export logs from all teraslice pods to our local machine when a pod exits (either a quick once job or a pod crashing). There is already a function that does something similar in e2e testing, so this shouldn't be too difficult.

We should consider how long these logs stick around. Maybe delete the directory when we shutdown the kind cluster?

godber commented 4 days ago

This is a bit trickier than you might think, unless kind holds onto them ... I see there's a kind export logs command. If you run that AFTER a pod has shut down, do you actually get the pod logs?