fluent / fluent-bit

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
https://fluentbit.io
Apache License 2.0
5.79k stars 1.57k forks source link

Collecting Traces from Container stdout and Sending to Jaeger #9040

Open muhmedabdelhalim opened 3 months ago

muhmedabdelhalim commented 3 months ago

Hello team,

I am exploring ways to enhance observability within my containerized environments and have a specific requirement. I am looking to collect trace data directly from the standard output (stdout) of containers and send this data to Jaeger for visualization and analysis.

Is there an existing feature in fluent-bit that supports this kind of data capture from stdout? If not, could this be considered for a new feature? What would be the recommended approach to implement this functionality if it doesn’t currently exist?

patrick-stephens commented 3 months ago

Does Jaegar support OTEL? If so you can send via the OTEL output to it, or maybe the HTTP one if not. https://docs.fluentbit.io/manual/pipeline/outputs/opentelemetry

For capturing from stdout, typically that goes to the kubelet log files and then is consumed that way like any other log file Fluent Bit would consume. Typically though these would be treated as log types rather than trace types I think though. There is also an OTEL input for this if you wanted to send direct that way: https://docs.fluentbit.io/manual/pipeline/inputs/opentelemetry

github-actions[bot] commented 2 days ago

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 5 days. Maintainers can add the exempt-stale label.