search

xamarin / xamarin-macios

.NET for iOS, Mac Catalyst, macOS, and tvOS provide open-source bindings of the Apple SDKs for use with .NET managed languages such as C#
Other
2.45k stars 511 forks source link

[CI] Fix mac tests on post build pipeline #20543

Closed mandel-macaque closed 5 months ago

mandel-macaque commented 5 months ago

To be able to download a artifact from a build that triggered the post build pipeline we cannot use the DownloadPipelineArtifact task with the same values since the artifact wont be found. This change adds an if statement to do the right thing based on the trigger so that we can have both pipelines running correctly until we remove the tests from the build.

vs-mobiletools-engineering-service2 commented 5 months ago

:books: [PR Build] Artifacts :books:

Packages generated

View packages * [xamarin.ios-17.3.0.401.pkg](https://dl.internalx.com/wrench/merge/c663aea288ce2c4a2e461fa51d2c739fdc0ea036/9506740/package/xamarin.ios-17.3.0.401.pkg) * [xamarin.mac-9.3.0.401.pkg](https://dl.internalx.com/wrench/merge/c663aea288ce2c4a2e461fa51d2c739fdc0ea036/9506740/package/xamarin.mac-9.3.0.401.pkg)

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: test results

26 tests crashed, 0 tests failed, 0 tests passed.

Failures

:x: cecil tests

:fire: Failed catastrophically on VSTS: test results - cecil (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (iOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_ios (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (MacCatalyst)

:fire: Failed catastrophically on VSTS: test results - dotnettests_maccatalyst (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (macOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_macos (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (Multiple platforms)

:fire: Failed catastrophically on VSTS: test results - dotnettests_multiple (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (tvOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_tvos (no summary found).

Html Report (VSDrops) Download

:x: framework tests

:fire: Failed catastrophically on VSTS: test results - framework (no summary found).

Html Report (VSDrops) Download

:x: fsharp tests

:fire: Failed catastrophically on VSTS: test results - fsharp (no summary found).

Html Report (VSDrops) Download

:x: generator tests

:fire: Failed catastrophically on VSTS: test results - generator (no summary found).

Html Report (VSDrops) Download

:x: install-source tests

:fire: Failed catastrophically on VSTS: test results - install-source (no summary found).

Html Report (VSDrops) Download

:x: interdependent-binding-projects tests

:fire: Failed catastrophically on VSTS: test results - interdependent-binding-projects (no summary found).

Html Report (VSDrops) Download

:x: introspection tests

:fire: Failed catastrophically on VSTS: test results - introspection (no summary found).

Html Report (VSDrops) Download

:x: linker tests

:fire: Failed catastrophically on VSTS: test results - linker (no summary found).

Html Report (VSDrops) Download

:x: mac-binding-project tests

:fire: Failed catastrophically on VSTS: test results - mac-binding-project (no summary found).

Html Report (VSDrops) Download

:x: mmp tests

:fire: Failed catastrophically on VSTS: test results - mmp (no summary found).

Html Report (VSDrops) Download

:x: mononative tests

:fire: Failed catastrophically on VSTS: test results - mononative (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (iOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_ios (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (MacCatalyst)

:fire: Failed catastrophically on VSTS: test results - monotouch_maccatalyst (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (macOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_macos (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (tvOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_tvos (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (watchOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_watchos (no summary found).

Html Report (VSDrops) Download

:x: msbuild tests

:fire: Failed catastrophically on VSTS: test results - msbuild (no summary found).

Html Report (VSDrops) Download

:x: mtouch tests

:fire: Failed catastrophically on VSTS: test results - mtouch (no summary found).

Html Report (VSDrops) Download

:x: xammac tests

:fire: Failed catastrophically on VSTS: test results - xammac (no summary found).

Html Report (VSDrops) Download

:x: xcframework tests

:fire: Failed catastrophically on VSTS: test results - xcframework (no summary found).

Html Report (VSDrops) Download

:x: xtro tests

:fire: Failed catastrophically on VSTS: test results - xtro (no summary found).

Html Report (VSDrops) Download

Successes

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Monterey (12) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Monterey (12) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Ventura (13) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Ventura (13) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS X64 - Mac Sonoma (14) passed :computer:

:white_check_mark: All tests on macOS X64 - Mac Sonoma (14) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Big Sur (11) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Big Sur (11) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:white_check_mark: API diff for current PR / commit

Legacy Xamarin (No breaking changes) * ~iOS~ (no change detected) * ~tvOS~ (no change detected) * ~watchOS~ (no change detected) * ~macOS~ (no change detected)
NET (empty diffs) * ~iOS~: (empty diff detected) * ~tvOS~: (empty diff detected) * ~MacCatalyst~: (empty diff detected) * ~macOS~: (empty diff detected)

:white_check_mark: API diff vs stable

Legacy Xamarin (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/ios-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/52f1ff0e23691984ac4154cb48dfefa4) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/tvos-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/92a030e047e477f9b3335aa49a1e80d6) (No breaking changes) * watchOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/watchos-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/8da301b8442c168c89b178a05f173d12) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/mac-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/2243d32f8c90e63f0fbc1ee4f4a2e86d) (No breaking changes)
.NET (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/bbe6a46a12aaf95e03acf7cea92def57) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/e4408723dd66e8a4d85cb7b692866a8c) (No breaking changes) * MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/Microsoft.MacCatalyst.Ref/ref/net8.0/Microsoft.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/b4998137a740d3812952eae29e3a915b) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/4f1a8b3a6a1c848b28eedfe2cf68f32c) (No breaking changes) * Microsoft.iOS vs Microsoft.MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/iOS-MacCatalyst-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/244efac2dbf2bba671b905b6a5f2353b)
Legacy Xamarin (stable) vs .NET * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/2725e091be329b91f5495152298f77cd) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/eb9c7e13ed47bdde1f145544bd032a25) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240430.12/9507590-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/d512d077793e396b235ea36c6eed1fc6)

:information_source: Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent Hash: 071aec4d5a2e8d987032c2d2f726a35509470ee3 [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [PR Build] Build failed :fire:

Build failed for the job 'Build packages'

Pipeline on Agent Hash: 071aec4d5a2e8d987032c2d2f726a35509470ee3 [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [PR Build] Build failed :fire:

Build failed for the job 'Build macOS tests'

Pipeline on Agent Hash: 0c935bb68ff388c28c816d6842a8d0996617a499 [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: test results

26 tests crashed, 0 tests failed, 0 tests passed.

Failures

:x: cecil tests

:fire: Failed catastrophically on VSTS: test results - cecil (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (iOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_ios (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (MacCatalyst)

:fire: Failed catastrophically on VSTS: test results - dotnettests_maccatalyst (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (macOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_macos (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (Multiple platforms)

:fire: Failed catastrophically on VSTS: test results - dotnettests_multiple (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (tvOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_tvos (no summary found).

Html Report (VSDrops) Download

:x: framework tests

:fire: Failed catastrophically on VSTS: test results - framework (no summary found).

Html Report (VSDrops) Download

:x: fsharp tests

:fire: Failed catastrophically on VSTS: test results - fsharp (no summary found).

Html Report (VSDrops) Download

:x: generator tests

:fire: Failed catastrophically on VSTS: test results - generator (no summary found).

Html Report (VSDrops) Download

:x: install-source tests

:fire: Failed catastrophically on VSTS: test results - install-source (no summary found).

Html Report (VSDrops) Download

:x: interdependent-binding-projects tests

:fire: Failed catastrophically on VSTS: test results - interdependent-binding-projects (no summary found).

Html Report (VSDrops) Download

:x: introspection tests

:fire: Failed catastrophically on VSTS: test results - introspection (no summary found).

Html Report (VSDrops) Download

:x: linker tests

:fire: Failed catastrophically on VSTS: test results - linker (no summary found).

Html Report (VSDrops) Download

:x: mac-binding-project tests

:fire: Failed catastrophically on VSTS: test results - mac-binding-project (no summary found).

Html Report (VSDrops) Download

:x: mmp tests

:fire: Failed catastrophically on VSTS: test results - mmp (no summary found).

Html Report (VSDrops) Download

:x: mononative tests

:fire: Failed catastrophically on VSTS: test results - mononative (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (iOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_ios (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (MacCatalyst)

:fire: Failed catastrophically on VSTS: test results - monotouch_maccatalyst (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (macOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_macos (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (tvOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_tvos (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (watchOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_watchos (no summary found).

Html Report (VSDrops) Download

:x: msbuild tests

:fire: Failed catastrophically on VSTS: test results - msbuild (no summary found).

Html Report (VSDrops) Download

:x: mtouch tests

:fire: Failed catastrophically on VSTS: test results - mtouch (no summary found).

Html Report (VSDrops) Download

:x: xammac tests

:fire: Failed catastrophically on VSTS: test results - xammac (no summary found).

Html Report (VSDrops) Download

:x: xcframework tests

:fire: Failed catastrophically on VSTS: test results - xcframework (no summary found).

Html Report (VSDrops) Download

:x: xtro tests

:fire: Failed catastrophically on VSTS: test results - xtro (no summary found).

Html Report (VSDrops) Download

Successes

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:books: [PR Build] Artifacts :books:

Packages generated

View packages * [xamarin.ios-17.3.0.404.pkg](https://dl.internalx.com/wrench/merge/779360130075c33b4b91892b272f530b97d72c20/9515065/package/xamarin.ios-17.3.0.404.pkg) * [xamarin.mac-9.3.0.404.pkg](https://dl.internalx.com/wrench/merge/779360130075c33b4b91892b272f530b97d72c20/9515065/package/xamarin.mac-9.3.0.404.pkg)

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [PR Build] Build failed :fire:

Build failed for the job 'Detect API changes'

Pipeline on Agent Hash: d8ccd9f44eedf2155267c672674544443374814a [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:books: [PR Build] Artifacts :books:

Packages generated

View packages * [xamarin.ios-17.3.0.411.pkg](https://dl.internalx.com/wrench/merge/593457b460653e21c950c8997eefcf6c4dc2f644/9515702/package/xamarin.ios-17.3.0.411.pkg) * [xamarin.mac-9.3.0.411.pkg](https://dl.internalx.com/wrench/merge/593457b460653e21c950c8997eefcf6c4dc2f644/9515702/package/xamarin.mac-9.3.0.411.pkg)

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS X64 - Mac Sonoma (14) passed :computer:

:white_check_mark: All tests on macOS X64 - Mac Sonoma (14) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Ventura (13) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Ventura (13) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Big Sur (11) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Big Sur (11) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Monterey (12) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Monterey (12) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [CI Build] Windows Integration Tests passed :computer:

:white_check_mark: All Windows Integration Tests passed.

Pipeline on Agent Hash: d8ccd9f44eedf2155267c672674544443374814a [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: test results

0 tests crashed, 4 tests failed, 98 tests passed.

Failures

:x: dotnettests tests (iOS)

1 tests failed, 0 tests passed.
* DotNet tests: Failed (Execution failed with exit code 1)

Html Report (VSDrops) Download

:x: msbuild tests

2 tests failed, 0 tests passed.
* MSBuild tests/Tasks: Failed (Execution failed with exit code 4) * MSBuild tests/Integration: Failed (Execution failed with exit code 106)

Html Report (VSDrops) Download

:x: mtouch tests

1 tests failed, 0 tests passed.
* MTouch tests/NUnit: Failed (Execution failed with exit code 9)

Html Report (VSDrops) Download

Successes

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 27 tests passed. Html Report (VSDrops) Download :white_check_mark: mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: mmp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mononative: All 6 tests passed. Html Report (VSDrops) Download :warning: monotouch (iOS): No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download :warning: monotouch (watchOS): No tests selected. Html Report (VSDrops) Download :white_check_mark: xammac: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xcframework: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [PR Build] Build failed :fire:

Build failed for the job 'Detect API changes'

Pipeline on Agent Hash: d8ccd9f44eedf2155267c672674544443374814a [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: test results

0 tests crashed, 4 tests failed, 98 tests passed.

Failures

:x: dotnettests tests (iOS) [attempt 2]

1 tests failed, 0 tests passed.
* DotNet tests: Failed (Execution failed with exit code 1)

Html Report (VSDrops) Download

:x: msbuild tests [attempt 2]

2 tests failed, 0 tests passed.
* MSBuild tests/Tasks: Failed (Execution failed with exit code 4) * MSBuild tests/Integration: Failed (Execution failed with exit code 104)

Html Report (VSDrops) Download

:x: mtouch tests [attempt 2]

1 tests failed, 0 tests passed.
* MTouch tests/NUnit: Failed (Execution failed with exit code 9)

Html Report (VSDrops) Download

Successes

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 27 tests passed. Html Report (VSDrops) Download :white_check_mark: mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: mmp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mononative: All 6 tests passed. Html Report (VSDrops) Download :warning: monotouch (iOS): No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download :warning: monotouch (watchOS): No tests selected. Html Report (VSDrops) Download :white_check_mark: xammac: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xcframework: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: test results

0 tests crashed, 3 tests failed, 99 tests passed.

Failures

:x: dotnettests tests (iOS) [attempt 3]

1 tests failed, 0 tests passed.
* DotNet tests: Failed (Execution failed with exit code 1)

Html Report (VSDrops) Download

:x: msbuild tests [attempt 3]

1 tests failed, 1 tests passed.
* MSBuild tests/Integration: Failed (Execution failed with exit code 10)

Html Report (VSDrops) Download

:x: mtouch tests [attempt 3]

1 tests failed, 0 tests passed.
* MTouch tests/NUnit: Failed (Execution failed with exit code 9)

Html Report (VSDrops) Download

Successes

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 27 tests passed. Html Report (VSDrops) Download :white_check_mark: mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: mmp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mononative: All 6 tests passed. Html Report (VSDrops) Download :warning: monotouch (iOS): No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download :warning: monotouch (watchOS): No tests selected. Html Report (VSDrops) Download :white_check_mark: xammac: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xcframework: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:books: [PR Build] Artifacts :books:

Packages generated

View packages * [xamarin.ios-17.3.0.414.pkg](https://dl.internalx.com/wrench/merge/06716cd7251a7dd7351b90b47362d4234c8cfdda/9531510/package/xamarin.ios-17.3.0.414.pkg) * [xamarin.mac-9.3.0.414.pkg](https://dl.internalx.com/wrench/merge/06716cd7251a7dd7351b90b47362d4234c8cfdda/9531510/package/xamarin.mac-9.3.0.414.pkg)

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:white_check_mark: API diff for current PR / commit

Legacy Xamarin (No breaking changes) * ~iOS~ (no change detected) * ~tvOS~ (no change detected) * ~watchOS~ (no change detected) * ~macOS~ (no change detected)
NET (empty diffs) * ~iOS~: (empty diff detected) * ~tvOS~: (empty diff detected) * ~MacCatalyst~: (empty diff detected) * ~macOS~: (empty diff detected)

:white_check_mark: API diff vs stable

Legacy Xamarin (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/ios-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/a2e9773a6beedfd9d343ee8fdbe8131d) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/tvos-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/1c0b70039c9e05210103dcfdace8f8f6) (No breaking changes) * watchOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/watchos-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/855a55269915848b11840e20b9da01e4) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/mac-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/f4912f7e94bccd7aa4182ae5926116e2) (No breaking changes)
.NET (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/118515f21bcdd8df09ac662e1cf20f2c) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/4b1db7255b6d616c963a2ee1c8c6029a) (No breaking changes) * MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/Microsoft.MacCatalyst.Ref/ref/net8.0/Microsoft.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/61ebeb91c69af66d60b359235dab2e31) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/0523f155b35beeda681b7488e639f911) (No breaking changes) * Microsoft.iOS vs Microsoft.MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/iOS-MacCatalyst-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/933e3de0225937fe2c6d9451a9901f5a)
Legacy Xamarin (stable) vs .NET * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/389ff3e2f85fa4a6c0068b90d662008f) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/06b9da993ca3958a4bde60d58ee8c44b) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.2/9531510-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/6dac3f3eabf72ad9b231d17ea9fee141)

:information_source: Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent Hash: 24fd340ffb28eab63cccdcbd8bde69aebd0f514a [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: test results

26 tests crashed, 0 tests failed, 0 tests passed.

Failures

:x: cecil tests

:fire: Failed catastrophically on VSTS: test results - cecil (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (iOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_ios (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (MacCatalyst)

:fire: Failed catastrophically on VSTS: test results - dotnettests_maccatalyst (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (macOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_macos (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (Multiple platforms)

:fire: Failed catastrophically on VSTS: test results - dotnettests_multiple (no summary found).

Html Report (VSDrops) Download

:x: dotnettests tests (tvOS)

:fire: Failed catastrophically on VSTS: test results - dotnettests_tvos (no summary found).

Html Report (VSDrops) Download

:x: framework tests

:fire: Failed catastrophically on VSTS: test results - framework (no summary found).

Html Report (VSDrops) Download

:x: fsharp tests

:fire: Failed catastrophically on VSTS: test results - fsharp (no summary found).

Html Report (VSDrops) Download

:x: generator tests

:fire: Failed catastrophically on VSTS: test results - generator (no summary found).

Html Report (VSDrops) Download

:x: install-source tests

:fire: Failed catastrophically on VSTS: test results - install-source (no summary found).

Html Report (VSDrops) Download

:x: interdependent-binding-projects tests

:fire: Failed catastrophically on VSTS: test results - interdependent-binding-projects (no summary found).

Html Report (VSDrops) Download

:x: introspection tests

:fire: Failed catastrophically on VSTS: test results - introspection (no summary found).

Html Report (VSDrops) Download

:x: linker tests

:fire: Failed catastrophically on VSTS: test results - linker (no summary found).

Html Report (VSDrops) Download

:x: mac-binding-project tests

:fire: Failed catastrophically on VSTS: test results - mac-binding-project (no summary found).

Html Report (VSDrops) Download

:x: mmp tests

:fire: Failed catastrophically on VSTS: test results - mmp (no summary found).

Html Report (VSDrops) Download

:x: mononative tests

:fire: Failed catastrophically on VSTS: test results - mononative (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (iOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_ios (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (MacCatalyst)

:fire: Failed catastrophically on VSTS: test results - monotouch_maccatalyst (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (macOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_macos (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (tvOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_tvos (no summary found).

Html Report (VSDrops) Download

:x: monotouch tests (watchOS)

:fire: Failed catastrophically on VSTS: test results - monotouch_watchos (no summary found).

Html Report (VSDrops) Download

:x: msbuild tests

:fire: Failed catastrophically on VSTS: test results - msbuild (no summary found).

Html Report (VSDrops) Download

:x: mtouch tests

:fire: Failed catastrophically on VSTS: test results - mtouch (no summary found).

Html Report (VSDrops) Download

:x: xammac tests

:fire: Failed catastrophically on VSTS: test results - xammac (no summary found).

Html Report (VSDrops) Download

:x: xcframework tests

:fire: Failed catastrophically on VSTS: test results - xcframework (no summary found).

Html Report (VSDrops) Download

:x: xtro tests

:fire: Failed catastrophically on VSTS: test results - xtro (no summary found).

Html Report (VSDrops) Download

Successes

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:books: [PR Build] Artifacts :books:

Packages generated

View packages * [xamarin.ios-17.3.0.420.pkg](https://dl.internalx.com/wrench/merge/353f20263dc192f5f9211bc66d2ba15b493dbc88/9533441/package/xamarin.ios-17.3.0.420.pkg) * [xamarin.mac-9.3.0.420.pkg](https://dl.internalx.com/wrench/merge/353f20263dc192f5f9211bc66d2ba15b493dbc88/9533441/package/xamarin.mac-9.3.0.420.pkg)

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS X64 - Mac Sonoma (14) passed :computer:

:white_check_mark: All tests on macOS X64 - Mac Sonoma (14) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Ventura (13) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Ventura (13) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Monterey (12) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Monterey (12) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [PR Build] Tests on macOS M1 - Mac Big Sur (11) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Big Sur (11) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:computer: [CI Build] Windows Integration Tests passed :computer:

:white_check_mark: All Windows Integration Tests passed.

Pipeline on Agent Hash: 47b1bfa35533bc96cd54ddfa8d9c7a0f7ee18d8a [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:rocket: [CI Build] Test results :rocket:

Test results

:white_check_mark: All tests passed on VSTS: test results.

:tada: All 170 tests passed :tada:

Tests counts

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: framework: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: install-source: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent-binding-projects: All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: introspection: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: linker: All 65 tests passed. Html Report (VSDrops) Download :white_check_mark: mac-binding-project: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: mmp: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mononative: All 6 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (iOS): All 11 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (MacCatalyst): All 7 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (macOS): All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (tvOS): All 11 tests passed. Html Report (VSDrops) Download :white_check_mark: monotouch (watchOS): All 4 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :white_check_mark: mtouch: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: xammac: All 3 tests passed. Html Report (VSDrops) Download :white_check_mark: xcframework: All 8 tests passed. Html Report (VSDrops) Download :white_check_mark: xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 5 months ago

:white_check_mark: API diff for current PR / commit

Legacy Xamarin (No breaking changes) * ~iOS~ (no change detected) * ~tvOS~ (no change detected) * ~watchOS~ (no change detected) * ~macOS~ (no change detected)
NET (empty diffs) * ~iOS~: (empty diff detected) * ~tvOS~: (empty diff detected) * ~MacCatalyst~: (empty diff detected) * ~macOS~: (empty diff detected)

:white_check_mark: API diff vs stable

Legacy Xamarin (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/ios-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/23b39cad0d1c0cc1806d84ebc2711238) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/tvos-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/212a5df5b9c94ad81dd1bb659a995b6c) (No breaking changes) * watchOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/watchos-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/b014da8e486d8f1be0844d364b87c8a9) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/mac-api-diff.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/0689710d22677986347568c3dcaba00b) (No breaking changes)
.NET (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/28c4ba7c27b2818a55f78ab2400d7abb) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/1c76b2572758ef4659ef838b765fdf90) (No breaking changes) * MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/Microsoft.MacCatalyst.Ref/ref/net8.0/Microsoft.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/8620b5aac25d28e8d2f33067a997d312) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/65a31b61135dbe18877cf96f40603c4a) (No breaking changes) * Microsoft.iOS vs Microsoft.MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/iOS-MacCatalyst-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/e4e140b1b13be3b80a79d851858a1f04)
Legacy Xamarin (stable) vs .NET * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/ebb53dcc81f00179b7ec08e79d802978) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/a28a150ea1468720187513fa303ba941) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240506.15/9533441-1/;/stable-api-comparison/diff/dotnet/legacy-diff/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/a111f67d473c46134932e2f08bc686a5)

:information_source: Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent Hash: 47b1bfa35533bc96cd54ddfa8d9c7a0f7ee18d8a [PR build]

mandel-macaque commented 5 months ago

The PR achieved what it was aiming:

  1. Tests work on CI: https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=9533440&view=results
  2. Tests work on a post pipeline: https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=9533687&view=results