search

Azure / batch-insights

One liners to enable Application insights on azure batch
MIT License
24 stars 16 forks source link

batch-insights running but no metrics available in both BatchExplorer and Application Insights #47

Open ruimlopes opened 3 years ago

ruimlopes commented 3 years ago

Use case

We have dynamic pools of 1 server each that we use to weekly run applications. We want to enable Application Insights for such servers but also have the metrics in BatchExplorer available.

Setup

I have a pool with the Start Task configured like this: image

Inside ./scripts/start_task.sh I have a few commands to prepare the pool and in the end: image

I mostly followed readme.md except having the run command inside my custom script. The value of BATCH_INSIGHTS_DOWNLOAD_URL is https://github.com/Azure/batch-insights/releases/download/v1.3.0/batch-insights.

Issue

There is no values in BatchExplorer nor Application Insights.

Diagnostic attempts

I looked into the contents of batch-insights.log:

User configuration:
   Pool ID: xxxxx
   Node ID: xxxxx
   Instrumentation Key: xxxxx
   Aggregation: 1
   Disable: []
   Monitoring processes: []
BatchInsights configuration:
   Pool ID: xxxxx
   Node ID: xxxxx
   Instrumentation Key: xxxxx
   Aggregation: 1m0s
   Sampling rate: 5000000000
   Disable: {"diskIO":false,"diskUsage":false,"networkIO":false,"gpu":false,"cpu":false,"memory":false}
   Monitoring processes: []
System information:
   OS: linux
No GPU detected. Nvidia driver might be missing. Error while initializing NVML could not load NVML library

If I ssh to the node I see batch-insights running: image

I am using ubuntuserver 18_04-lts-gen2 but I also tested with 20.04 with the same result.