Certification test failed

[mixturify]

Describe the bug When creating release app package, the certification test failed

Steps to reproduce the bug VS 2019 > UWP App > Publish > Create App Package

Expected behavior Validating app from the certification test.

Screenshots

Version Info Latest Windows 10 version

NuGet package version: Microsoft.UI.XAML 2.3.191211002

Windows 10 version	Saw the problem?
May 2019 Update (18362)	Yes

Device form factor	Saw the problem?
Desktop	Yes

Additional context Prior Microsoft.UI.XAML version (2.2) work without any problem! In the past I was that issue because I build also with ARM64, maybe it's related!

[ranjeshj]

@mixturify Can you check your app manifest file and see if there are multiple entries for Microsoft.UI.Xaml ?

[mixturify]

@ranjeshj hi, there is just 1 entry. Anyway the packages are still made. Maybe It will still pass the store certification.

[ranjeshj]

Are you able to reproduce this with a blank uwp app ? Can you share the version of VS19 you are using ?

[jevansaks]

Duplicate of #1747

[mixturify]

I've made an blank app and worked and VS in version 16.4.2

Then, I just made a clean up the bin / obj folders of the apps, updated again the nugets packages and everything work good now. I don't know, maybe it's random, maybe something from csproject settings. I was not aware about the other ticket #1747 but anyway for resolving that strange bug, just clean up the app generated files!

[ThE-TiGeR]

I have exactly the same problem. I allready cleaned my project and did a full rebuild. I am using VS2019 16.4.2, Windows App Certification Kit 10.0.0.18362.1 If I install the package by myself everything is working fine, but I need to run the Certification Kit to verify if I do not use wrong api because of using also c++ code in the app.

Was there a solution found for this?

[StephenLPeters]

I have exactly the same problem. I allready cleaned my project and did a full rebuild. I am using VS2019 16.4.2, Windows App Certification Kit 10.0.0.18362.1 If I install the package by myself everything is working fine, but I need to run the Certification Kit to verify if I do not use wrong api because of using also c++ code in the app.

Was there a solution found for this?

According to #1747 this issue was fixed with an update to VS, but it looks like you are one a pretty new version yourself. @michael-hawker Can you confirm the version of VS that the fix is included in? Is it possible this has regressed again?

[michael-hawker]

@StephenLPeters I don't work on VS, I was just being a messenger from what I had heard on the other thread. I believe it's in the Preview though not the 16.4.x. I just updated an app in the store the other week with the latest WinUI though, so it shouldn't block submissions.

@LyalinDotCom do you know who owns this part of VS and could comment?

[jevansaks]

Are you blocked from running the Certification Test locally only? Or is this also blocking your store submissions?

There was at least one issue with the WACK test in the 1903 Windows SDK which was patched in a version of the WACK that went to the store but isn't available in any officially released Windows SDK. The fixed version is available in insider SDKs though.

[ThE-TiGeR]

I did not try to submit it until know. I just wanted to test if the app is still compliant because I did a lot of changes in the past

[matthewacme]

I can report I currently am having the same exact problem. I also cleaned my project, deleted all bin and obj folders, completely rebuilt from scratch and I am using VS2019 16.4.2, Windows App Certification Kit 10.0.0.18362.1

System configuration below

Microsoft Visual Studio Professional 2019 Version 16.4.2 VisualStudio.16.Release/16.4.2+29613.14 Microsoft .NET Framework Version 4.8.03752

Installed Version: Professional

Visual C++ 2019 00435-60000-00000-AA931 Microsoft Visual C++ 2019

.ignore 1.2.77 A language service that makes it painless to handle all types of .ignore files such as .gitignore, .tfignore, etc.

Add New File 3.5.138 The fastest and easiest way to add new files to any project - including files that start with a dot

ADL Tools Service Provider 1.0 This package contains services used by Data Lake tools

ASA Service Provider 1.0

ASP.NET and Web Tools 2019 16.4.457.38025 ASP.NET and Web Tools 2019

ASP.NET Web Frameworks and Tools 2012 16.4.457.38025 For additional information, visit https://www.asp.net/

ASP.NET Web Frameworks and Tools 2019 16.4.457.38025 For additional information, visit https://www.asp.net/

Azure App Service Tools v3.0.0 16.4.457.38025 Azure App Service Tools v3.0.0

Azure Data Lake Node 1.0 This package contains the Data Lake integration nodes for Server Explorer.

Azure Data Lake Tools for Visual Studio 2.4.5000.0 Microsoft Azure Data Lake Tools for Visual Studio

Azure Functions and Web Jobs Tools 16.4.457.38025 Azure Functions and Web Jobs Tools

Azure Stream Analytics Tools for Visual Studio 2.4.5000.0 Microsoft Azure Stream Analytics Tools for Visual Studio

C# Tools 3.4.1-beta4-19610-02+c4e5d138903b899477649a17f197abd2bcb22f9e C# components used in the IDE. Depending on your project type and settings, a different version of the compiler may be used.

Common Azure Tools 1.10 Provides common services for use by Azure Mobile Services and Microsoft Azure Tools.

Extensibility Message Bus 1.2.0 (d16-2@8b56e20) Provides common messaging-based MEF services for loosely coupled Visual Studio extension components communication and integration.

Fabric.DiagnosticEvents 1.0 Fabric Diagnostic Events

Farticus 2.0.3 The original Visual Studio fart app

Git Tools 2019 3.1.1 This extension provides a git changes window, and menus to launch Git Bash, Git Extenstions and TortoiseGit.

GitHub.VisualStudio 2.10.8.8132 A Visual Studio Extension that brings the GitHub Flow into Visual Studio.

IncrediBuild Build Acceleration 1.5.0.10 IncrediBuild effectively reduces compilation and development times by up to 90%.

IntelliCode Extension 1.0 IntelliCode Visual Studio Extension Detailed Info

Material icons generator 1.8.60 This plugin help you to add material design icons to your Android, iOS or UWP project

Microsoft Azure HDInsight Azure Node 2.4.5000.0 HDInsight Node under Azure Node

Microsoft Azure Hive Query Language Service 2.4.5000.0 Language service for Hive query

Microsoft Azure Service Fabric Tools for Visual Studio 16.0 Microsoft Azure Service Fabric Tools for Visual Studio

Microsoft Azure Stream Analytics Language Service 2.4.5000.0 Language service for Azure Stream Analytics

Microsoft Azure Stream Analytics Node 1.0 Azure Stream Analytics Node under Azure Node

Microsoft Azure Tools 2.9 Microsoft Azure Tools for Microsoft Visual Studio 2019 - v2.9.21016.1

Microsoft Continuous Delivery Tools for Visual Studio 0.4 Simplifying the configuration of Azure DevOps pipelines from within the Visual Studio IDE.

Microsoft JVM Debugger 1.0 Provides support for connecting the Visual Studio debugger to JDWP compatible Java Virtual Machines

Microsoft Library Manager 2.0.87+gbb515bf382 Install client-side libraries easily to any web project

Microsoft MI-Based Debugger 1.0 Provides support for connecting Visual Studio to MI compatible debuggers

Microsoft Visual C++ Wizards 1.0 Microsoft Visual C++ Wizards

Microsoft Visual Studio Tools for Containers 1.1 Develop, run, validate your ASP.NET Core applications in the target environment. F5 your application directly into a container with debugging, or CTRL + F5 to edit & refresh your app without having to rebuild the container.

Microsoft Visual Studio VC Package 1.0 Microsoft Visual Studio VC Package

Mono Debugging for Visual Studio 16.5.24 (1fafd7e) Support for debugging Mono processes with Visual Studio.

Multilingual App Toolkit 4.0 Multilingual App Toolkit helps you localize your Windows Store app by providing file management, pseudo and machine translation, translation editor, and build integration. http://aka.ms/matinstall

NuGet Package Manager 5.4.0 NuGet Package Manager in Visual Studio. For more information about NuGet, visit https://docs.nuget.org/

ProjectServicesPackage Extension 1.0 ProjectServicesPackage Visual Studio Extension Detailed Info

SendMeThatPackage Extension 1.0 SendMeThatPackage Visual Studio Extension Detailed Info

SQL Server Data Tools 16.0.61912.09160 Microsoft SQL Server Data Tools

StopOnFirstBuildError 1.0 StopOnFirstBuildError

Stops a solution build immediately after a project has failed to build.

http://tech.einaregilsson.com/2011/01/06/stop-build-on-first-error-in-visual-studio-2010/

StylerPackage Extension 1.0 StylerPackage Visual Stuido Extension Detailed Info

Surface Dial Tools for Visual Studio 0.8.68 Adds features to Visual Studio specific to the Surface Dial. You don't need a Surface Book or Surface Studio to take advantage of the Surface Dial.

Syntax Visualizer 1.0 An extension for visualizing Roslyn SyntaxTrees.

Test Adapter for Boost.Test 1.0 Enables Visual Studio's testing tools with unit tests written for Boost.Test. The use terms and Third Party Notices are available in the extension installation directory.

Test Adapter for Google Test 1.0 Enables Visual Studio's testing tools with unit tests written for Google Test. The use terms and Third Party Notices are available in the extension installation directory.

ToolWindowHostedEditor 1.0 Hosting json editor into a tool window

TypeScript Tools 16.0.11031.2001 TypeScript Tools for Microsoft Visual Studio

Visual Basic Tools 3.4.1-beta4-19610-02+c4e5d138903b899477649a17f197abd2bcb22f9e Visual Basic components used in the IDE. Depending on your project type and settings, a different version of the compiler may be used.

Visual C++ for Cross Platform Mobile Development (Android) 16.0.29428.195 Visual C++ for Cross Platform Mobile Development (Android)

Visual C++ for Linux Development 1.0.9.29512 Visual C++ for Linux Development

Visual F# Tools 10.4 for F# 4.6 16.4.0-beta.19556.5+e7597deb7042710a7142bdccabd6f92b0840d354 Microsoft Visual F# Tools 10.4 for F# 4.6

Visual Studio Code Debug Adapter Host Package 1.0 Interop layer for hosting Visual Studio Code debug adapters in Visual Studio

Visual Studio Container Tools Extensions (Preview) 1.0 View, manage, and diagnose containers within Visual Studio.

Visual Studio Tools for CMake 1.0 Visual Studio Tools for CMake

Visual Studio Tools for CMake 1.0 Visual Studio Tools for CMake

Visual Studio Tools for Containers 1.0 Visual Studio Tools for Containers

Visual Studio Tools for Kubernetes 1.0 Visual Studio Tools for Kubernetes

VisualStudio.DeviceLog 1.0 Information about my package

VisualStudio.Mac 1.0 Mac Extension for Visual Studio

Windows Template Studio 3.5.19310.1 Windows Template Studio quickly builds a UWP app, using a wizard-based UI to turn your needs into a foundation of Windows 10 patterns and best practices.

Xamarin 16.4.000.307 (d16-4@e031886) Visual Studio extension to enable development for Xamarin.iOS and Xamarin.Android.

Xamarin Designer 16.4.0.464 (remotes/origin/d16-4@4abf337c3) Visual Studio extension to enable Xamarin Designer tools in Visual Studio.

Xamarin Templates 16.4.25 (579ee62) Templates for building iOS, Android, and Windows apps with Xamarin and Xamarin.Forms.

Xamarin.Android SDK 10.1.1.0 (d16-4/f2c9364) Xamarin.Android Reference Assemblies and MSBuild support. Mono: bef1e63 Java.Interop: xamarin/java.interop/d16-4@c4e569f ProGuard: xamarin/proguard/master@905836d SQLite: xamarin/sqlite/3.28.0@46204c4 Xamarin.Android Tools: xamarin/xamarin-android-tools/master@9f4ed4b

Xamarin.iOS and Xamarin.Mac SDK 13.8.3.0 (0d8fe21) Xamarin.iOS and Xamarin.Mac Reference Assemblies and MSBuild support.

[michael-hawker]

❗ Calling this out as important from @jevansaks (maybe we can edit the initial post at put it at the top of the issue)

There was at least one issue with the WACK test in the 1903 [18362] Windows SDK which was patched in a version of the WACK that went to the store but isn't available in any officially released Windows SDK. The fixed version is available in insider SDKs though.

@jevansaks to clarify, if they pull just any preview SDK newer than 18362 on an insider build that should resolve the issue?

[jevansaks]

❗ Calling this out as important from @jevansaks (maybe we can edit the initial post at put it at the top of the issue)

There was at least one issue with the WACK test in the 1903 [18362] Windows SDK which was patched in a version of the WACK that went to the store but isn't available in any officially released Windows SDK. The fixed version is available in insider SDKs though.

@jevansaks to clarify, if they pull just any preview SDK newer than 18362 on an insider build that should resolve the issue?

That's my understanding, but I haven't heard anyone who ran into this problem confirm it does resolve it. If it doesn't then we need to loop in SDK folks again.

[sibille]

We ran into this problem on one of our build servers executing WACK tests for Windows Template Studio. I tried to install a preview SDK (10.0.19546.1000) but could not, as the SKD is not compatible with the machine (Windows 10 Version 1909).

[vigouredelaruse]

i find i can reliably fix this issue with a commit that looks as per the attached image - the issue is still current to the WACK insider windows 10 sdk/build

unfortunately this workaround requires using the pre-release microsoft.ui.xaml

[ThE-TiGeR]

This issue still happens with the version 2.4

[ThE-TiGeR]

I updated to VS2019 16.6.0 and SDK 10.0.19041.0, it still has this issue with the App Certification Kit 10.0.19041.0

[mobiletonster]

I'm seeing the same issue with my WACK

I'm still using version 10.0.18362.1 of the WACK.

[ranjeshj]

@jevansaks Looks like we are hitting this issue again. Can you loop in the SDK folks who can help ?

[StephenLPeters]

@jevansaks and @ranjeshj where did we land on this?

[ranjeshj]

From earlier in the thread it looks like there was an issue in WACK that was fixed after 18362. @ThE-TiGeR you mentioned that you used a newer version (19041) but still hit the issue. Are you seeing this with a blank app ? Is there a repro you could share ?

[scout208]

I can confirm that installing the latest prerelease version of Microsoft.UI.Xaml (v2.5.0-prerelease.200923002) fixes this issue. So, I'm guessing that this will be resolved in the next general release of Microsoft.UI.Xaml?

[michael-hawker]

@scout208 the pre-release builds are built differently than the main releases, so a test with a build from their main pipeline should be done.

[scout208]

@michael-hawker Yeah, that's what I started with and that one doesn't work.

[LucaZiegler]

Same issue with Xamarin Forms (UWP) and latest Visual Studio and Nuget Packages, submission to Microsoft Store also failing.

[tualatin]

Same here, current Visual Studio 2022 version, latest nuget packages.

[bpulliam]

The original issue was with WinUI 2 and VS 2019. If you see this issue now, please open a new issue so we can track it correctly.