microsoft / vs-extension-testing

Integration test harness for Visual Studio extension development
MIT License
14 stars 7 forks source link

# Visual Studio Extension Testing

This project allows Visual Studio extension developers to write integration tests that run inside an experimental instance of Visual Studio.

License NuGet package

Installation and Use

Requirements

Install the test harness

Install the test package for the applicable version(s) of Visual Studio

Visual Studio Version Integration Testing Package
2022 Microsoft.VisualStudio.Extensibility.Testing.Xunit
2012 - 2019 Microsoft.VisualStudio.Extensibility.Testing.Xunit.Legacy

Configure the test framework

Classic projects

Add the following to AssemblyInfo.cs to enable the test framework:

using Xunit;

[assembly: TestFramework("Xunit.Harness.IdeTestFramework", "Microsoft.VisualStudio.Extensibility.Testing.Xunit")]

SDK projects

💡 By default, SDK projects automatically generate the required assembly attribute. Manual customization is only required if the default assembly attributes support has been disabled, or in cases where the automatic application of TestFrameworkAttribute is not desired.

To disable generation of TestFrameworkAttribute (which will require manual addition similar to classic projects), add the following to the project file:

<PropertyGroup>
  <GenerateTestFrameworkAttribute>false</GenerateTestFrameworkAttribute>
</PropertyGroup>

Configure extensions for deployment

Add the following to AssemblyInfo.cs to deploy extensions required for testing.

using Xunit.Harness;

[assembly: RequireExtension("Extension.File.Name.vsix")]

Ensure test discovery is enabled

Test projects using a customized xUnit test framework cannot currently be discovered while tests are being written. The test discovery process that runs after a build completes will detect the required tests. Ensure this feature is enabled by the following steps:

  1. Open ToolsOptions...
  2. Select the Test page on the left
  3. Ensure Additionally discover tests from built assemblies after builds is checked

Tests will be automatically discovered and Test Explorer updated after each successful build.

Write tests

Apply the [IdeFact] attribute to tests that need to run in the IDE. After building the project, the tests will appear in Test Explorer where they can be launched for running and/or debugging directly.

Contributing

Please see CONTRIBUTING.md for information about our Code of Conduct and contributing guidelines.