MicrosoftPremier / VstsExtensions

Documentation and issue tracking for Microsoft Premier Services Visual Studio Team Services Extensions
MIT License
59 stars 14 forks source link

Show the new warnings in the "Build Quality Checks" task #143

Closed SamTh3D3v closed 3 years ago

SamTh3D3v commented 3 years ago

I am using "Build Quality Checks" task to check if the warning counts has increased in a build compared to a previous one.

The task return a summarized report showing the warning count (and fails if the warnings increased!), something like:

Total warnings: 22, Filtered warnings: 22

Question Is there a way to show the new warnings in the new build? Currently, I have to go through the previous build and manually compare its warnings with the warnings in the new build in order to identify the new ones! This is a really tedious task, is there a built in way that automates that and show only the new warnings in the report?

Thanks!

ReneSchumacher commented 3 years ago

Hi @SamTh3D3v,

sorry for the late response. You can enable the warning statistics option. This generates more detailed information about the warnings that have been added or removed.

SamTh3D3v commented 3 years ago

Hi @ReneSchumacher,

No worries at all, I appreciate you taking the time to look into this!

Yes, the stat option is enabled in the task:

image

That's the kind of output I am getting from the task:

image

The build solution task, does log the warnings in the vso format and all:

image

Any thoughts pls?

ReneSchumacher commented 3 years ago

The statistics are not in the log. There is a section called "Extensions" in the pipeline summary view, and you will find the statistics there.

ReneSchumacher commented 3 years ago

Btw: I'd recommend updating to the latest version of the Build Quality Checks task. It has a couple improvements and bug fixes, and I believe the statistics are way better on the newer versions.

SamTh3D3v commented 3 years ago

Oh I see, my bad I was looking in the wrong location! But, still the output doesn't look that helpful, will the update fix that?

ReneSchumacher commented 3 years ago

Yes, it will. We added more details with version 7.4.0 if I remember correctly. It'll give you the exact warnings that have changed. It at least we try to 😉 Since the task only has limited context for each warning, we use a heuristic to find the changes. So far, I haven't heard any complaints, though.

SamTh3D3v commented 3 years ago

I appreciate your help, thank you ^^.