search

newrelic-experimental / gitlab

Gitlab exporters to send metrics,logs,traces to New Relic
9 stars 6 forks source link

GitLab integration with newrelic #20

Closed devpv-ram closed 1 year ago

devpv-ram commented 1 year ago

I configured all the environment variables and also configured the exporters which are mentioned in the blog but still I didn't get any data on my NewRelic UI.

Screenshot 2023-08-02 at 11 16 02 AM Screenshot 2023-08-02 at 11 24 57 AM Screenshot 2023-08-02 at 11 26 44 AM

dpacheconr commented 1 year ago

Gitlab runner with docker executor is required to run the exporters, the second screenshot shows kubernetes executor so that might be why. I have not tested compatibility with kubernetes executors. Have you tried using docker executor?

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: devpv-ram @.> Sent: Wednesday, August 2, 2023 4:18:22 PM To: newrelic-experimental/gitlab @.> Cc: Subscribed @.***> Subject: [newrelic-experimental/gitlab] GitLab integration with newrelic (Issue #20)

I configured all the environment variables and also configured the exporters which are mentioned in the bloghttps://newrelic.com/blog/how-to-relic/monitor-gitlab-with-opentelemetry but still I didn't get any data on my NewRelic UI.

[Screenshot 2023-08-02 at 11 16 02 AM]https://user-images.githubusercontent.com/84476911/257860000-7f1cdc88-a766-4bcf-9625-77fc37c530a6.png [Screenshot 2023-08-02 at 11 16 45 AM]https://user-images.githubusercontent.com/84476911/257860182-6264491e-8b24-4889-a5c8-865a4972d423.png [Screenshot 2023-08-02 at 11 17 16 AM]https://user-images.githubusercontent.com/84476911/257860328-89f45405-5759-40b4-b405-473c809b5c9d.png

— Reply to this email directly, view it on GitHubhttps://github.com/newrelic-experimental/gitlab/issues/20, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYBQSMJZ775V6FHCEFIFVBTXTJVT5ANCNFSM6AAAAAA3BOAUWI. You are receiving this because you are subscribed to this thread.Message ID: @.***>

devpv-ram commented 1 year ago

Updated the exporter to run with Docker executor. Still nothing on newrelic side

Screenshot 2023-08-03 at 12 02 04 PM
dpacheconr commented 1 year ago

Hi

After line 11 on your screenshot what do you get?

I would expect some errors or something similar to [image: image.png]

Have you double checked you using the license/ingest api and it's correctly set no spaces before or after?

Are you using a personal gitlab token or group token?

Regards

Diogo Pacheco Senior Solutions Architect EMEA Field Engineering Team www.newrelic.com http://www.newrelic.com

On Thu, 3 Aug 2023 at 17:05, devpv-ram @.***> wrote:

Updated the exporter to run with Docker executor. Still nothing on newrelic side [image: Screenshot 2023-08-03 at 12 02 04 PM] https://user-images.githubusercontent.com/84476911/258170026-8fcca609-73e9-48ca-b883-ddbd84775237.png

— Reply to this email directly, view it on GitHub https://github.com/newrelic-experimental/gitlab/issues/20#issuecomment-1664253711, or unsubscribe https://github.com/notifications/unsubscribe-auth/AYBQSMNKOIFUYFTS73Q6EH3XTPD5XANCNFSM6AAAAAA3BOAUWI . You are receiving this because you commented.Message ID: @.***>

devpv-ram commented 1 year ago

The pipeline ran successfully without any errors.

I'm using a personal gitlab token

Screenshot 2023-08-03 at 12 16 52 PM
dpacheconr commented 1 year ago

Hi

The message means the configuration in use did not provide you access to any projects so there was nothing to export.

Can you send a screenshot of the environment variables in use?

Regards

Diogo Pacheco Senior Solutions Architect EMEA Field Engineering Team www.newrelic.com http://www.newrelic.com

On Thu, 3 Aug 2023 at 17:19, devpv-ram @.***> wrote:

The pipeline ran successfully without any errors.

I'm using a personal gitlab token [image: Screenshot 2023-08-03 at 12 16 52 PM] https://user-images.githubusercontent.com/84476911/258173879-ff3fde42-5fcb-4256-843d-af26b183f330.png

— Reply to this email directly, view it on GitHub https://github.com/newrelic-experimental/gitlab/issues/20#issuecomment-1664273150, or unsubscribe https://github.com/notifications/unsubscribe-auth/AYBQSMISLTSFWFE5PFG5ILTXTPFRBANCNFSM6AAAAAA3BOAUWI . You are receiving this because you commented.Message ID: @.***>

devpv-ram commented 1 year ago

I'm using these variables.

GLAB_TOKEN: $GLAB_TOKEN
NEW_RELIC_API_KEY: $NEW_RELIC_API_KEY
GLAB_EXPORT_PROJECTS_REGEX: ".*"
GLAB_EXPORT_GROUPS_REGEX: ".*"
dpacheconr commented 1 year ago

Hi

Remove GLAB_EXPORT_GROUPS_REGEX: "." and GLAB_EXPORT_PROJECTS_REGEX: "." and try again.

This will allow it to run with all default values.

Let us know if that works

Regards

Diogo Pacheco Senior Solutions Architect EMEA Field Engineering Team www.newrelic.com http://www.newrelic.com

On Thu, 3 Aug 2023 at 17:41, devpv-ram @.***> wrote:

I'm using these variables.

GLAB_TOKEN: $GLAB_TOKEN NEW_RELIC_API_KEY: $NEW_RELIC_API_KEY GLAB_EXPORT_PROJECTS_REGEX: "." GLAB_EXPORT_GROUPS_REGEX: "."

— Reply to this email directly, view it on GitHub https://github.com/newrelic-experimental/gitlab/issues/20#issuecomment-1664304171, or unsubscribe https://github.com/notifications/unsubscribe-auth/AYBQSMIHJNT7NZBHMLRBOHTXTPID5ANCNFSM6AAAAAA3BOAUWI . You are receiving this because you commented.Message ID: @.***>

devpv-ram commented 1 year ago

Pipeline ran successfully after removing those variables. Still nothing exported to newrelic dashboard

Created fresh repository. Checking out 556b17e8 as detached HEAD (ref is SRE-159)... Skipping Git submodules setup $ git remote set-url origin "${CI_REPOSITORY_URL}" Executing "step_script" stage of the job script 00:02 Using docker image sha256:e46e8a7013e18f5e2557dab7559e5f9f91007211f0beda33159701f68404588e for docker.io/dpacheconr/gitlab-metrics-exporter:1.0.6 with digest dpacheconr/gitlab-metrics-exporter@sha256:802d8efd4c80e6d4f1a1419c5a9cab2ddf8dc44d83bec8a10352abb7546a44a8 ... Found total of 0 projects using -> OWNED: True and VISIBILITY: private. Checking which ones match provided paths and project regex configuration Nothing to export check your configuration!!! Cleaning up project directory and file based variables 00:01 Job succeeded

dpacheconr commented 1 year ago

You won’t see anything because logs are saying the projects you have are not owned.

If you look at the line owned and visibility it says it can’t find any owned projects with visibility private.

You will need to check your projects configuration and amend these variables according to your setup

Happy to setup call to discuss this further if you wish

Regards Diogo

Sent from Outlook for iOShttps://aka.ms/o0ukef

From: devpv-ram @.> Sent: Thursday, August 3, 2023 5:50:21 PM To: newrelic-experimental/gitlab @.> Cc: Diogo Pacheco @.>; Comment @.> Subject: Re: [newrelic-experimental/gitlab] GitLab integration with newrelic (Issue #20)

Pipeline ran successfully after removing those variables. Still nothing exported to newrelic dashboard

Created fresh repository. Checking out 556b17e8 as detached HEAD (ref is SRE-159)... Skipping Git submodules setup $ git remote set-url origin "${CI_REPOSITORY_URL}" Executing "step_script" stage of the job script 00:02 Using docker image sha256:e46e8a7013e18https://gitlab.com/propertyvista/devops/gitlab-repo-management/-/jobs/4800506139#L18f5e2557dab7559e5f9f91007211f0beda33159701f68404588e for docker.io/dpacheconr/gitlab-metrics-exporter:1.0.6 with digest @.***:802d8efd4c80e6d4f1a1419https://gitlab.com/propertyvista/devops/gitlab-repo-management/-/jobs/4800506139#L19c5a9cab2ddf8dc44d83bec8a10352abb7546a44a8 ... Found total of 0 projects using -> OWNED: True and VISIBILITY: private. Checking which ones match provided paths and project regex configuration Nothing to export check your configuration!!! Cleaning up project directory and file based variables 00:01 Job

— Reply to this email directly, view it on GitHubhttps://github.com/newrelic-experimental/gitlab/issues/20#issuecomment-1664315890, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYBQSMLD5F5IVGRTWXX63JTXTPJE3ANCNFSM6AAAAAA3BOAUWI. You are receiving this because you commented.Message ID: @.***>

devpv-ram commented 1 year ago

Please send me a link to your calendar to schedule a call. Thank you.

dpacheconr commented 1 year ago

Hi

I am available Wednesday 12pm-4pm UK time.

Let me know if that works for you and what email shall I send the invite to.

Regards

Diogo Pacheco Senior Solutions Architect EMEA Field Engineering Team www.newrelic.com http://www.newrelic.com

On Thu, 3 Aug 2023 at 21:38, devpv-ram @.***> wrote:

Please send me a link to your calendar to schedule a call. Thank you.

— Reply to this email directly, view it on GitHub https://github.com/newrelic-experimental/gitlab/issues/20#issuecomment-1664616942, or unsubscribe https://github.com/notifications/unsubscribe-auth/AYBQSMO35WVM5N4LXWF5DVDXTQD4FANCNFSM6AAAAAA3BOAUWI . You are receiving this because you commented.Message ID: @.***>

devpv-ram commented 1 year ago

Hi. Can we schedule the call for 3 p.m UK time / 10 a.m ET. Please send me the invite Thank you!

dpacheconr commented 1 year ago

I sent you an invite. Regards

Diogo Pacheco Senior Solutions Architect EMEA Field Engineering Team www.newrelic.com http://www.newrelic.com

On Tue, 8 Aug 2023 at 16:28, devpv-ram @.***> wrote:

Hi. Can we schedule the call for 3 p.m UK time / 10 a.m ET. Please send me the invite on @.*** Thank you!

— Reply to this email directly, view it on GitHub https://github.com/newrelic-experimental/gitlab/issues/20#issuecomment-1669838005, or unsubscribe https://github.com/notifications/unsubscribe-auth/AYBQSMOSLC2TMTQIDO6LH7TXUJLITANCNFSM6AAAAAA3BOAUWI . You are receiving this because you commented.Message ID: @.***>

dpacheconr commented 1 year ago

resolved by updating GLAB_PROJECT_OWNERSHIP variable