search

xamarin / xamarin-macios

.NET for iOS, Mac Catalyst, macOS, and tvOS provide open-source bindings of the Apple SDKs for use with .NET managed languages such as C#
Other
2.42k stars 507 forks source link

[release/8.0.1xx-xcode15.1] [monotouch-test] Be a bit more lenient with expected results in CGImageSourceTest. #20666

Closed vs-mobiletools-engineering-service2 closed 4 weeks ago

vs-mobiletools-engineering-service2 commented 1 month ago

The exact results seem to depend on a lot of factors, so just accept them all.

Backport of #20640

vs-mobiletools-engineering-service2 commented 1 month ago

:books: [PR Build] Artifacts :books:

Packages generated

View packages

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 1 month ago

:computer: [PR Build] Tests on macOS M1 - Mac Big Sur (11.5) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Big Sur (11.5) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 1 month ago

:computer: [PR Build] Tests on macOS M1 - Mac Ventura (13.0) passed :computer:

:white_check_mark: All tests on macOS M1 - Mac Ventura (13.0) passed.

Pipeline on Agent Hash: [PR build]

vs-mobiletools-engineering-service2 commented 1 month ago

:computer: [CI Build] Windows Integration Tests passed :computer:

:white_check_mark: All Windows Integration Tests passed.

Pipeline on Agent Hash: f5586a2b18c58a79176314a86fd446b03ae76f92 [PR build]

vs-mobiletools-engineering-service2 commented 1 month ago

:white_check_mark: API diff for current PR / commit

NET (empty diffs) * ~iOS~: (empty diff detected) * ~tvOS~: (empty diff detected) * ~MacCatalyst~: (empty diff detected) * ~macOS~: (empty diff detected)

:white_check_mark: API diff vs stable

.NET (No breaking changes) * iOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240531.1/9660167-1/;/stable-api-comparison/diff/dotnet/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/785d67eb20b68c1be5cd6365975e11ae) (No breaking changes) * tvOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240531.1/9660167-1/;/stable-api-comparison/diff/dotnet/Microsoft.tvOS.Ref/ref/net8.0/Microsoft.tvOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/c9207a0462cb41ec40dee21b1cb89d47) (No breaking changes) * MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240531.1/9660167-1/;/stable-api-comparison/diff/dotnet/Microsoft.MacCatalyst.Ref/ref/net8.0/Microsoft.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/6ebabaf6839ba89fe2f42125b3f9ec91) (No breaking changes) * macOS: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240531.1/9660167-1/;/stable-api-comparison/diff/dotnet/Microsoft.macOS.Ref/ref/net8.0/Microsoft.macOS.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/8218375885f1b19f1fb48fb749026b96) (No breaking changes) * Microsoft.iOS vs Microsoft.MacCatalyst: [vsdrops](https://vsdrop.corp.microsoft.com/file/v1/xamarin-macios/detected-changes/20240531.1/9660167-1/;/stable-api-comparison/diff/dotnet/iOS-MacCatalyst-diff/Microsoft.iOS.Ref/ref/net8.0/Microsoft.iOS.MacCatalyst.html) [gist](https://gist.github.com/vs-mobiletools-engineering-service2/f0eddbabc54a1ae782c8433df0c48912)

:information_source: Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent Hash: f5586a2b18c58a79176314a86fd446b03ae76f92 [PR build]

vs-mobiletools-engineering-service2 commented 1 month ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: simulator tests

0 tests crashed, 6 tests failed, 89 tests passed.

Failures

:x: fsharp tests

1 tests failed, 3 tests passed.
* fsharp/iOS Unified 64-bits - simulator/Debug [dotnet]: Crashed

Html Report (VSDrops) Download

:x: framework tests

2 tests failed, 2 tests passed.
* framework-test/iOS Unified 64-bits - simulator/Debug [dotnet]: Crashed * framework-test/tvOS - simulator/Debug [dotnet]: Crashed

Html Report (VSDrops) Download

:x: introspection tests

1 tests failed, 3 tests passed.
* introspection/Mac [dotnet]/Debug [dotnet]: Failed (Test run failed. Tests run: 33 Passed: 32 Inconclusive: 0 Failed: 1 Ignored: 0)

Html Report (VSDrops) Download

:x: xcframework tests

2 tests failed, 2 tests passed.
* xcframework-test/iOS Unified 64-bits - simulator/Debug [dotnet]: Crashed * xcframework-test/tvOS - simulator/Debug [dotnet]: Crashed

Html Report (VSDrops) Download

Successes

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: generator: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent_binding_projects: All 4 tests passed. Html Report (VSDrops) Download :warning: install_source: No tests selected. Html Report (VSDrops) Download :white_check_mark: linker: All 40 tests passed. Html Report (VSDrops) Download :warning: mac_binding_project: No tests selected. Html Report (VSDrops) Download :warning: mmp: No tests selected. Html Report (VSDrops) Download :warning: mononative: No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch: All 29 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :warning: mtouch: No tests selected. Html Report (VSDrops) Download :warning: xammac: No tests selected. Html Report (VSDrops) Download :white_check_mark: xtro: All 1 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: f5586a2b18c58a79176314a86fd446b03ae76f92 [PR build]

vs-mobiletools-engineering-service2 commented 1 month ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: simulator tests

0 tests crashed, 3 tests failed, 92 tests passed.

Failures

:x: framework tests [attempt 2]

2 tests failed, 2 tests passed.
* framework-test/iOS Unified 64-bits - simulator/Debug [dotnet]: Crashed * framework-test/tvOS - simulator/Debug [dotnet]: Crashed

Html Report (VSDrops) Download

:x: introspection tests [attempt 2]

1 tests failed, 3 tests passed.
* introspection/Mac [dotnet]/Debug [dotnet]: Failed (Test run failed. Tests run: 33 Passed: 32 Inconclusive: 0 Failed: 1 Ignored: 0)

Html Report (VSDrops) Download

Successes

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 4 tests passed. [attempt 2] Html Report (VSDrops) Download :white_check_mark: generator: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent_binding_projects: All 4 tests passed. Html Report (VSDrops) Download :warning: install_source: No tests selected. Html Report (VSDrops) Download :white_check_mark: linker: All 40 tests passed. Html Report (VSDrops) Download :warning: mac_binding_project: No tests selected. Html Report (VSDrops) Download :warning: mmp: No tests selected. Html Report (VSDrops) Download :warning: mononative: No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch: All 29 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :warning: mtouch: No tests selected. Html Report (VSDrops) Download :warning: xammac: No tests selected. Html Report (VSDrops) Download :white_check_mark: xcframework: All 4 tests passed. [attempt 2] Html Report (VSDrops) Download :white_check_mark: xtro: All 1 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: f5586a2b18c58a79176314a86fd446b03ae76f92 [PR build]

vs-mobiletools-engineering-service2 commented 4 weeks ago

:fire: [CI Build] Test results :fire:

Test results

:x: Tests failed on VSTS: simulator tests

0 tests crashed, 1 tests failed, 94 tests passed.

Failures

:x: introspection tests [attempt 3]

1 tests failed, 3 tests passed.
* introspection/Mac [dotnet]/Debug [dotnet]: Failed (Test run failed. Tests run: 33 Passed: 32 Inconclusive: 0 Failed: 1 Ignored: 0)

Html Report (VSDrops) Download

Successes

:white_check_mark: cecil: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: dotnettests: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: fsharp: All 4 tests passed. [attempt 2] Html Report (VSDrops) Download :white_check_mark: framework: All 4 tests passed. [attempt 3] Html Report (VSDrops) Download :white_check_mark: generator: All 1 tests passed. Html Report (VSDrops) Download :white_check_mark: interdependent_binding_projects: All 4 tests passed. Html Report (VSDrops) Download :warning: install_source: No tests selected. Html Report (VSDrops) Download :white_check_mark: linker: All 40 tests passed. Html Report (VSDrops) Download :warning: mac_binding_project: No tests selected. Html Report (VSDrops) Download :warning: mmp: No tests selected. Html Report (VSDrops) Download :warning: mononative: No tests selected. Html Report (VSDrops) Download :white_check_mark: monotouch: All 29 tests passed. Html Report (VSDrops) Download :white_check_mark: msbuild: All 2 tests passed. Html Report (VSDrops) Download :warning: mtouch: No tests selected. Html Report (VSDrops) Download :warning: xammac: No tests selected. Html Report (VSDrops) Download :white_check_mark: xcframework: All 4 tests passed. [attempt 2] Html Report (VSDrops) Download :white_check_mark: xtro: All 1 tests passed. Html Report (VSDrops) Download

Pipeline on Agent Hash: f5586a2b18c58a79176314a86fd446b03ae76f92 [PR build]

rolfbjarne commented 4 weeks ago

Test failure is unrelated (#20667).