Build Quality Checks Extension fails on dotnetcore solution in ADO

[Sean-Steefel]

Logs check for build warnings no issue, fails on code coverage without throwing error but it looks to be a timeout issue:

2021-02-26T19:28:32.1697108Z ##[section]Starting: Build & Code Coverage Quality Check 2021-02-26T19:28:32.1982448Z ============================================================================== 2021-02-26T19:28:32.1983044Z Task : Build Quality Checks 2021-02-26T19:28:32.1983551Z Description : Breaks a build based on quality metrics like number of warnings or code coverage. 2021-02-26T19:28:32.1984007Z Version : 7.6.2 2021-02-26T19:28:32.1984348Z Author : Microsoft 2021-02-26T19:28:32.1984884Z Help : [Docs] 2021-02-26T19:28:32.1985492Z ============================================================================== 2021-02-26T19:28:33.1335296Z SystemVssConnection exists true 2021-02-26T19:28:33.5240431Z Using IdentifierJobResolver 2021-02-26T19:28:33.5879286Z Validating build warnings policy... 2021-02-26T19:28:33.7309367Z Running task warnings analysis... 2021-02-26T19:28:33.7319826Z Counting warnings from tasks: 2021-02-26T19:28:33.7321065Z - Restore 2021-02-26T19:28:34.0832587Z Running generic task log analysis... 2021-02-26T19:28:34.1303781Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:34.1304973Z - Build 2021-02-26T19:28:34.3244831Z Running detailed task log analysis... 2021-02-26T19:28:34.3379463Z Total warnings: 1, Filtered warnings: 1 2021-02-26T19:28:34.3380279Z - Test 2021-02-26T19:28:34.3913447Z Running generic task log analysis... 2021-02-26T19:28:34.3916382Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:34.3917256Z - Build solution hfm.SF/hfm.SF.sfproj 2021-02-26T19:28:34.5305404Z Running generic task log analysis... 2021-02-26T19:28:34.5399444Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:34.5410284Z Overall total warnings: 1 2021-02-26T19:28:34.5411289Z Overall filtered warnings: 1 2021-02-26T19:28:34.6488040Z Found baseline build with ID 38135. 2021-02-26T19:28:34.7147904Z Running task warnings analysis... 2021-02-26T19:28:34.7156063Z Counting warnings from tasks: 2021-02-26T19:28:34.7156786Z - Restore 2021-02-26T19:28:35.0411651Z Running generic task log analysis... 2021-02-26T19:28:35.0759419Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.0760596Z - Build 2021-02-26T19:28:35.1921187Z Running detailed task log analysis... 2021-02-26T19:28:35.1923155Z Total warnings: 1, Filtered warnings: 1 2021-02-26T19:28:35.1924142Z - Test 2021-02-26T19:28:35.2531089Z Running generic task log analysis... 2021-02-26T19:28:35.2537234Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.2538422Z - Build solution hfm.SF/hfm.SF.sfproj 2021-02-26T19:28:35.4228246Z Running generic task log analysis... 2021-02-26T19:28:35.4315800Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.4316743Z - Publish 2021-02-26T19:28:35.4828218Z Running generic task log analysis... 2021-02-26T19:28:35.4841396Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.4842738Z - Publish CommandProcessor WebJob 2021-02-26T19:28:35.5975834Z Running generic task log analysis... 2021-02-26T19:28:35.5977133Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.5977770Z - Publish DataSync WebJob 2021-02-26T19:28:35.6486346Z Running generic task log analysis... 2021-02-26T19:28:35.6489898Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.6490771Z - Publish CacheSeeder WebJob 2021-02-26T19:28:35.6982712Z Running generic task log analysis... 2021-02-26T19:28:35.6983831Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.6987905Z - Publish Data Sanitizer WebJob 2021-02-26T19:28:35.8092982Z Running generic task log analysis... 2021-02-26T19:28:35.8094057Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.8094981Z - Publish ScheduleCommands WebJob 2021-02-26T19:28:35.8734615Z Running generic task log analysis... 2021-02-26T19:28:35.8739129Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.8740057Z - Publish Notifications WebJob copy 2021-02-26T19:28:35.9315290Z Running generic task log analysis... 2021-02-26T19:28:35.9317070Z Total warnings: 0, Filtered warnings: 0 2021-02-26T19:28:35.9324636Z Overall total warnings: 1 2021-02-26T19:28:35.9325337Z Overall filtered warnings: 1 2021-02-26T19:28:35.9336130Z [SUCCESS] Warnings policy passed with 1 warning(s). 2021-02-26T19:28:36.0243925Z Statistics generation took 87.245ms 2021-02-26T19:28:36.0305168Z Validating code coverage policy... 2021-02-26T19:28:39.0220039Z Waiting for code coverage data... 2021-02-26T19:28:41.3908435Z Waiting for code coverage data... 2021-02-26T19:28:43.7195770Z Waiting for code coverage data... 2021-02-26T19:28:46.2241954Z Waiting for code coverage data... ........ ........ Many more lines like above "Waiting for code coverage data" ........ 2021-02-26T19:38:31.4426643Z Waiting for code coverage data... 2021-02-26T19:38:34.3119498Z Waiting for code coverage data... 2021-02-26T19:38:36.4833976Z [WARNING] Unable to get code coverage data within the maximum wait time. 2021-02-26T19:38:36.4860592Z ##[warning]Unable to get code coverage data within the maximum wait time. 2021-02-26T19:38:36.4872586Z Total lines: 0 2021-02-26T19:38:36.4873200Z Covered lines: 0 2021-02-26T19:38:36.4873725Z Code Coverage (%): 100 2021-02-26T19:38:36.5526007Z Found baseline build with ID 38135. 2021-02-26T19:38:36.6401419Z Waiting for code coverage data... 2021-02-26T19:38:36.9221709Z Successfully read code coverage data from build. 2021-02-26T19:38:36.9232867Z Evaluating coverage data from 1 filtered code coverage data sets... 2021-02-26T19:38:36.9272167Z Total lines: 45541 2021-02-26T19:38:36.9273255Z Covered lines: 31199 2021-02-26T19:38:36.9274160Z Code Coverage (%): 68.5075 2021-02-26T19:38:36.9285296Z [SUCCESS] Code coverage policy passed with 100% (0/0 lines). 2021-02-26T19:38:38.6616899Z ##[section]Finishing: Build & Code Coverage Quality Check

[ReneSchumacher]

Hi @Sean-Steefel,

could you please send an email with the name of your organization to PSGerExtSupport@microsoft.com so we can check if you're affected by a "broken" feature that results in coverage data not being processed quickly enough for BQC to see it? We can mitigate this by disabling a feature flag.

Unfortunately, I am currently pretty much blocked by my day-to-day job and won't have time until around Easter to work on a more permanent solution for Azure DevOps Services.

[ReneSchumacher]

@Sean-Steefel Does the issue still occur? I haven't received any additional information.

[ReneSchumacher]

Closing this due to lack of information. If the issue still occurs, please add another comment.

[markpattison]

Hi @ReneSchumacher,

I'm seeing this as well, specifically when using the DotNetCore build/test tasks. I've emailed you with my organisation name.