microsoft / testbase

Samples and Tools for Test Base for M365.
MIT License
40 stars 16 forks source link
compatibility-test samples sdk test-automation windows-10 windows-11

Important: Test Base for Microsoft 365 will transition to end-of-life (EOL) on May 31, 2024.

We're committed to working closely with each customer to provide support and guidance to make the transition as smooth as possible. If you have any questions, concerns, or need assistance, submit a support request.

Test Base for Microsoft 365

Test Base for Microsoft 365 is an Azure service that facilitates data-driven testing of applications. Backed by the power of data and the cloud, it enables IT professionals to take advantage of intelligent testing from anywhere in the world. It will help you test your applications without the hassle, time commitment, and expenditure of setting up and maintaining complex test environments. Most importantly, it will give you access to pre-release Windows Updates on secure virtual machines (VMs) and world-class intelligence for your applications.

This repository contains various samples and utilities to build a Test Base package.

Best Practices

Provide you with some useful samples of Test Base integration, which are best practices to use Test Base, such as

Sample app source code

It contains the source code of the sample app. This app is a sample/test app to try out the functionality of Test Base.

Sample List

Two types of samples are included in this repository: Package and SDK.

Package Samples

We provide many package samples with different test types and different languages. Most of the samples use Calculator as the test target.

Out of Box

An OOB test performs an install, launch, close, and uninstall of your application. After the install, the launch-close routine is repeated 30 times before a single uninstall is run. The OOB test provides you with standardized telemetry on your package to compare across Windows builds.

Two OOB samples are provided, click the links to find more details:

Functional

A Functional test executes your uploaded test script(s) on your package. The scripts are run in the sequence you specified and a failure in a particular script will stop subsequent scripts from executing.

Appium is levaraged to do UI automation test. And MSTest is levaraged to do CLI test. Also C#, Java, Python are used in the samples.

Here is the list of current functional test samples, click the links to find more details:

Flow Driven

Flow driven test allows you to arrange your test scripts with enhanced flow control. To help you comprehensively validate the impact of an in-place Windows upgrade, you can use flow driven tests to execute your tests on both the baseline OS and target OS with a side-by-side test result comparison.

The Flow driven test samples will be available soon.

SDK Samples

Test Base provides APIs/SDK to help you manage Test Base resources, get test results programmatically, and integrate them with our CI tools. SDK samples show how to use Test Base SDK in different ways.

To provide feedback, make feature proposals, or participate in polls, visit Discussions page.

Useful links