jenkinsci / opentelemetry-plugin

Monitor and observe Jenkins with OpenTelemetry.
https://plugins.jenkins.io/opentelemetry/
Apache License 2.0
97 stars 50 forks source link

Jenkins overview shows blank #535

Closed Neelam-zanvar closed 1 year ago

Neelam-zanvar commented 1 year ago

image image image image image These are the configurations I've made. and on elk server i have only installed apm-server all are 8.4.2 version. The jenkins overview dashboard isnt loading

v1v commented 1 year ago

Thanks for reaching out.

Unfortunately, there is no much we can do, there is no information regarding the controller, plugin version or even logs

We don't know much about your services and how they are configured, whether they can see each other, the security configuration or how the OTEL collector is enabled and configured.

I could guess from the screenshots:

  1. the apm server/OTEL collector connection is not authenticated, is that the expected configuration? Is the APM server/OTEL connector configured without any security?
  2. Elastic user doesn't have access to the elasticsearch
Neelam-zanvar commented 1 year ago

Well i am now able to see the dashboard. i had missed the import dashboard to kibana step. but i am still getting few metrics as blank image image image

i am not using otel collector. sending metrics from jenkins to apm directly. apm has no authorization. elasticsearch has(i have added the correct credentials for connecting to elasticsearch still it shows the error as shown in the screenshot below image

elk stack and apm server version is 8.4.2 jenkins version is [Jenkins 2.361.2] opentelemetry plugin version2.9.2

no logs on jenkins side image

getting these for apm server

v1v commented 1 year ago

Unfortunately, I cannot provide any answers as I don't know the existing networking topology for your existing services and whether they can see each other.

I can say there are some errors in the screenshots you provided:

Failed to connect to ... 401: Unauthorized

I tried your setup with the demo environment:

And it worked fine, you can try my demo in

Then run the below commands

$ make -C demos build
$ make -C demos start-all

Open your browser with the URL http://localhost:8080/ and run some Jenkins jobs then you will see those traces in http://localhost:5601/app/apm/services/jenkins/overview?comparisonEnabled=true&environment=ENVIRONMENT_ALL&kuery=&latencyAggregationType=avg&offset=1d&rangeFrom=now-15h&rangeTo=now&serviceGroup=&transactionType=request

You can see the Jenkins logs specific for the OpenTelemetry plugin in http://localhost:8080/manage/log/Otel/

Unfortunately, I don't know if you have configured the APM Server with the authentication, but if Agent authorization has been configured in the APM Server integration, that could be the problem.

Finally the configuration of any OTEL vendors is not something we handle individually within this project.

Neelam-zanvar commented 1 year ago

I figured out the failed to conenct issue. My filebeat was running on that machine and was misconfigured. so i turned it off as of now. Is it ok that i dont use a collector and i fleet server? i have just used otel plugin and elastic APM. While configuring the plugin also i am getting errors as shown in screenshots previously. if i select dont store logs also i am still getting this image I am missing some minor thing which i am not able to figure out. Only few things in jenkins overview dashboard are missing.

image image

v1v commented 1 year ago

while configuring the plugin also i am getting errors as shown in screenshots previously.

Already reported on https://github.com/jenkinsci/opentelemetry-plugin/issues/437

Neelam-zanvar commented 1 year ago

is using fleet server and collector mandatory?

Best regards,

Neelam Zanvar Hanabaratti

Infrastructure & DevOps Engineer

Mobile: +91 8792429745

www.minutuscomputing.comhttps://www.minutuscomputing.com/


From: Victor Martinez @.> Sent: Monday, October 17, 2022 4:39 PM To: jenkinsci/opentelemetry-plugin @.> Cc: Neelam Hanabaratti @.>; Author @.> Subject: Re: [jenkinsci/opentelemetry-plugin] Jenkins overview shows blank (Issue #535)

CAUTION: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.

while configuring the plugin also i am getting errors as shown in screenshots previously.

Already reported on #437https://github.com/jenkinsci/opentelemetry-plugin/issues/437

— Reply to this email directly, view it on GitHubhttps://github.com/jenkinsci/opentelemetry-plugin/issues/535#issuecomment-1280689821, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXOU6YA5TYH364N7PVGVMY3WDUXYJANCNFSM6AAAAAAREBWDRI. You are receiving this because you authored the thread.Message ID: @.***>

Minutus Computing Disclaimer

This message contains confidential information and is intended only for the individual(s) addressed in the message. If you aren't the named addressee, you should not disseminate, distribute, or copy this e-mail. If you aren't the intended recipient, you are notified that disclosing, distributing, or copying this e-mail is strictly prohibited. Minutus Computing does not accept or assume any liability or responsibility for any use of or reliance on this email.

v1v commented 1 year ago

is using fleet server and collector mandatory?

No, this plugin works with all the Vendors that support OpenTelemetry natively or they have support with the OpenTelemetry collector:

Neelam-zanvar commented 1 year ago

Okay thank you for your support and time. I'll go through the links you've sent

Get Outlook for Androidhttps://aka.ms/AAb9ysg


From: Victor Martinez @.> Sent: Monday, October 17, 2022 5:06:09 PM To: jenkinsci/opentelemetry-plugin @.> Cc: Neelam Hanabaratti @.>; Author @.> Subject: Re: [jenkinsci/opentelemetry-plugin] Jenkins overview shows blank (Issue #535)

CAUTION: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.

is using fleet server and collector mandatory?

No, this plugin works with all the Vendors that support OpenTelemetry natively or they have support with the OpenTelemetry collector:

— Reply to this email directly, view it on GitHubhttps://github.com/jenkinsci/opentelemetry-plugin/issues/535#issuecomment-1280719901, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXOU6YFF66YODZUA3VV733LWDU22TANCNFSM6AAAAAAREBWDRI. You are receiving this because you authored the thread.Message ID: @.***>

Minutus Computing Disclaimer

This message contains confidential information and is intended only for the individual(s) addressed in the message. If you aren't the named addressee, you should not disseminate, distribute, or copy this e-mail. If you aren't the intended recipient, you are notified that disclosing, distributing, or copying this e-mail is strictly prohibited. Minutus Computing does not accept or assume any liability or responsibility for any use of or reliance on this email.