search

MicrosoftPremier / VstsExtensions

Documentation and issue tracking for Microsoft Premier Services Visual Studio Team Services Extensions
MIT License
59 stars 14 forks source link

Is it possible to check diff coverage with this extension? #139

Open Giuspepe opened 3 years ago

Giuspepe commented 3 years ago

First of all, thanks for creating this great extension :) I just have a quick question regarding diff coverage. Is it possible to check diff coverage (e.g. that newly added code in a pull request must be fully covered, like here: https://docs.microsoft.com/en-us/azure/devops/pipelines/test/codecoverage-for-pullrequests?view=azure-devops)?

Thanks in advance for your help!

ReneSchumacher commented 3 years ago

Hi @Giuspepe,

unfortunately, the task cannot check diff coverage at the moment. Build Quality Checks is not evaluating coverage itself; instead it simply reads coverage values as they have been published from Azure DevOps. When I last talked to the testing tools team, there wasn't any diff coverage API available so our task can't read that from the service. It's still on our roadmap to switch from simply reading coverage data to evaluating coverage directly in the task, which would solve a couple other things like timing issue that come from the asynchronous processing of coverage data in Azure DevOps. Yet, I'm currently the only one developing the extensions and I'll probably won't have time to work on that in the near future. I can probably spend some time during my next vacation (end of June) to work on the parsing of coverage data, which would then allow us to calculate diff coverage as well (or at least it should allow us to do that).

Cheers, René

Giuspepe commented 3 years ago

Hi @ReneSchumacher,

alright, thanks for your quick reply and your effort!