containers / ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman
Apache License 2.0
111 stars 110 forks source link

[WIP] observability with bootc example (kepler & opentelemetry-collector) #666

Open sallyom opened 4 months ago

sallyom commented 4 months ago

This is PoC for adding observability (Kepler and OpenTelemetry Collector) to a bootc system. Not specific to AI workloads so not sure it belongs in this repo, but if everyone running AI workloads requires an observability solution, than perhaps it does belong here.