search

F5Networks / f5-telemetry-streaming

F5 BIG-IP Telemetry Streaming
Apache License 2.0
55 stars 24 forks source link

Add logging support to open-telemetry consumer #206

Open jessed opened 2 years ago

jessed commented 2 years ago

Is your feature request related to a problem? Please describe.

Add logging support to the open-telemetry consumer.

Describe the solution you'd like

The open-telemetry consumer was added to telemetry-streaming in v1.23, and became supported in v1.27; however this consumer only supports metrics data and not log entries. Several (most? all) other consumers support both. This request is for the open-telemetry consumer to support logging as well.

This functionality is required for cloud providers like Oracle, that the telemetry-streaming package does not have a specific consumer for.

Describe alternatives you've considered

At this time we are forced to send logs to a separate linux VM that can then forward the logs to Oracle using the Oracle logging agent. This approach works, but it is quite inefficient.

Additional context

In Issue 150 a request for an OCI consumer was rejected on the basis that the development focus was shifting from providing additional consumers to the use of OpenTelemetry. Now that an OpenTelemetry consumer has been released we would like it to have feature parity with other consumers for cloud providers, list the providers for GCP, AWS, and Azure all do.

dstokesf5 commented 2 years ago

Thank you for your feedback. I agree that adding logging to the Open Telemetry consumer is critical. Unfortunately, we have been waiting for the logging specification to be marked as stable, or at least some news on when it may become stable. We will likely need to add logging support before this happens. I have added this to our internal product backlog as TS-662.

kwlooi commented 2 years ago

Thank you @dstokesf5, as I have stated earlier in Issue 150, the use of OCI REST API to get the logs is not going to work because we need to keep generating the signature to call the APIs - the signature is NOT static.

Right now we have to set up a separate VM in Oracle Cloud to extract the F5 syslogs. This temporary solution is different from the other clouds we use - Azure, AWS, and GCP. What we are looking for is a parity with these other cloud providers to have a similar Push Consumer for the logs to OCI.

kwlooi commented 2 years ago

@cnad001 - please add your comments too.

amolari commented 8 months ago

What about implementing this feature ?