Explore & Connect: Making long term logs (archive, S3) viewable in OBS logging console

[schwesig]

Explore & Connect: Making long term logs (archive, S3) viewable in OBS logging console

We have successfully set up an OpenShift cluster dedicated to observability (obs cluster), where log files are collected and stored using Loki and subsequently mirrored to an S3 storage for extended retention.

Problem:

We've found that while we can see recent logs (Log Bucket) in our logging console, we can't see older logs stored in the Backup Bucket. This issue is about fixing that by linking our S3 stored logs with OBS/logging console.

see docs/architecture/logging/

Goals

• Connect Backup Bucket stored logs with our logging console so we can view all logs easily.

Tasks

• [ ] 1. Research: Look into ways to connect S3 logs with the console.
• [ ] 2. Implementation: Create and implement.

[schwesig]

/cc @computate @bnshr @jbasu01 @harshil-codes