newrelic-experimental / newrelic-snowflake-integration

New Relic integration with Snowflake to monitor query performance, logins, potential security incidents, optimise warehouse and cloud credit costs, capture any data stored in Snowflake for real-time alerting and reporting
Apache License 2.0
13 stars 17 forks source link

Only seeing metrics for the VM running the agent rather than snowflake. #35

Open adlangx opened 2 years ago

adlangx commented 2 years ago

This could definitely be my lack of familiarity with NR, but I'm not sure what I am missing.

I am using Ubuntu 20.04

I followed the README, I can see that the service is running and there are no errors in the syslog. So everything seems happy.

When I go to NR however I do not see the metrics or queries I am expecting, instead I see data about the VM that the agent is on.

I'll add a Loom to illustrate:

https://www.loom.com/share/fac6976c7aa7499189e03170db7826f7

adlangx commented 2 years ago

Oops, I missed issue #34 I am seeing the same thing in the data explorer

adlangx commented 2 years ago

Looks like issue #29 is a match to what I am seeing. I am unsure what I need to add to the config.yml though.

adlangx commented 2 years ago

OK, for us the issue was that the query table_storage_usage.sql was never completing and so none of the data was coming in.

For a quick fix we just commented out that query in the flexconfig

   #- name: snowflakeTableStorageUsage
    #  entity: snowflake
    #  event_type: SnowflakeAccount
    #  custom_attributes:
    #    metric_type: snowflake.table_storage_usage
    #  commands:
    #    - run: /home/azureuser/newrelic-snowflake-integration/snowflakeintegration-linux /home/azureuser/newrelic-snowflake-integration/config.yaml /home/azureuser/newrelic-snowflake-integration/queries/>

After that restarted the service and we were good.

Another note is that if you have a null obfuscation value but a value in the 'key' field in the config.yml the connection will fail. For example:

authentication:
  obfuscation: #optional
    key: replaceme