search

microsoft / vscode-extension-telemetry

Node module to help VS Code extensions send telemetry using application insights
https://www.npmjs.com/package/@vscode/extension-telemetry
Other
125 stars 46 forks source link

Extension telemetry stopped collecting ~3 weeks ago #184

Closed kingdonb closed 11 months ago

kingdonb commented 12 months ago

I have reviewed a lot of docs, and I believe I am using Application Insights Instrumentation Key as described by the docs.

However, all of my telemetry collection stopped 3 weeks ago. I've gone ahead and updated the vscode engine, the vscode/extension-telemetry dependency, and everything else in the immediate vicinity that I can think of. I've enabled trace so I can see the telemetry events that are going out from my extension. But they don't show up at all on the application insights dash.

Screenshot 2023-09-08 at 4 32 38 PM

Everything just dropped off the radar about 3 weeks ago. I've seen #183 and I got most of the ideas for how to attempt to resolve this from reading associated threads off of there, but no avail. I'm on the latest version. Are metrics down for everyone or just me?

I've seen https://github.com/microsoft/vscode-extension-telemetry/issues/183#issuecomment-1710869927 which indicates metrics should still be working, but I'm not certain what configuration that would have been with. I've found a lot of conflicting notes in the docs and it's not clear to me if the problem is on my end at this point.

kingdonb commented 12 months ago

My extension is this one:

https://github.com/weaveworks/vscode-gitops-tools

and the fixes I've tried are on the edge branch, we did a major upgrade on the extension unrelated to telemetry in the last 30 days and it's possible that we upgraded something, but seems unlikely that 100% of the clients would have upgraded and received it all at once. The big upgrade was published on July 28, so I'm pretty sure that had nothing to do with it.

lramos15 commented 11 months ago

That's interesting, #183 uses a completely different code path (not App insights) so a lot of the issues there shouldn't affect you. Did you update the module recently?

kingdonb commented 11 months ago

Not until after I started having issues, no. At that point I realized my engine and the dependency itself were both quite out of date, so I figured the best plan was to upgrade.

I tried that in the edge branch, we have pushed updates to (attempt to) use the latest version of the telemetry package, but all of my experiments have been failure and I haven't seen any sign of telemetry since that day in August, when we did no release.

I think it must have been we're using a deprecated path, but I haven't found anything to clarify it since I posted this. No sign that we are even ingesting metrics at all except for the "Server exceptions and dependency failures" which all appeared to be server exceptions, however I don't understand how to delve into those errors and see details about them.

lramos15 commented 11 months ago

Try updating your webpack externals

https://github.com/microsoft/vscode/blob/24739b3e01f8f7d27efa33e7ff9101fb8157032d/extensions/shared.webpack.config.js#L147-L154

kingdonb commented 11 months ago

@lramos15 Not sure if we actually did that, but it looks like September 17 telemetry started up again.

This was 2 days after our most proximate release, and it was another 2 weeks almost before we made another release after that. I'm inclined to think that something was broken at Microsoft Azure and they fixed it, (or else there was something broken about my account subscription and it's been fixed by someone else when I wasn't paying attention.)

🤷 closing