search

Altinn / altinn-studio

Next generation open source Altinn platform and applications.
https://docs.altinn.studio
BSD 3-Clause "New" or "Revised" License
114 stars 70 forks source link

Randomly failing tests in App.IntegrationTestsRef.csproj project #7080

Closed SandGrainOne closed 2 years ago

SandGrainOne commented 3 years ago

Describe the bug

The tests performed in the App.IntegrationTestsRef.csproj project can randomly fail. It happens because tests running in parallel would sometimes interfere with each other.

The most common scenario is having one test trying to use a file that has been deleted or is being locked by another test.

See the run history of aspnet-template-analysis-dotnet. Search for example after the test GetActiveInstances_LastChangedByUser_MappedSuccessfullyAndReturneOk in build 264580.

To Reproduce

  1. Run tests and observe the failing tests that have previously ran successfully.

Expected behavior

  1. Tests doesn't randomly fail
SandGrainOne commented 2 years ago

All tests are currently stable. Stable enough for the pull request pipeline results to be consistent.