This release includes several performance enhancements. @lahma provided a massive speed improvement for large, parametrized test suites. In addition, equivalency tests with large unsortable collections run faster by determining if the collections are sortable before attempting to sort them.
We've added several fixes for .NET 6.0 and we've stopped testing NUnit against .NET Core 2.1 which is now out of support.
There are also several fixes for the new FixtureLifeCycle feature and other smaller bug fixes and performance improvements.
This release fixes a new issue with the FixtureLifeCycle attribute where IDisposable test fixtures were not being disposed properly. As always, @gleb-osokin has been a great help with this new feature.
It also fixes a long-standing performance issue with CollectionAssert.AreEquivalent and the CollectionEquivalentConstraint when comparing large collections. The deep comparison that NUnit performs on the two collections will always have a worst case bound of O(n^2) but we have optimized it so that the majority of use cases will be closer to O(n).
We've also made significant optimizations to the OR filters for selecting tests using their full name. This dramatically improves test performance for large code bases that use dotnet test. Thanks to @pakrym for his help with this.
This release includes several performance enhancements. @lahma provided a massive speed improvement for large parametrized test suites. In addition, quivalency tests with large unsortable collections run faster by determining if the collections are sortable before attempting to sort them.
We've added several fixes for .NET 6.0 and we've stopped testing NUnit against .NET Core 2.1 which is now out of support.
There are also several fixes for the new FixtureLifeCycle feature and other smaller bug fixes and performance improvements.
Issues Resolved
2963 Flakey tests in FrameworkControllerTests
3643 Assert.Pass(message) produces "reason" in XML-Result
3841 Breaking change: Is.SupersetOf with ValueTuple requires IComparable in NUnit 3.13.2
3843 IDisposable & InstancePerTestCase: Object created for OneTimeSetUp is not disposed
3898 NUnit 3.13.2 : LessThanOrEqualTo fails on a case which should succeed
3903 Backport race condition fix (PR 3883)
3904 Backport fix for "IDisposable & InstancePerTestCase" (PR 3843)
3929 Fix high precision decimal calculations in v3.13 (#3898)
3959 Marked 'NUnitEqualityComparer.AreEqual(object, object, Tolerance, bool)' as obsolete
3962 Ensure that AfterTest always runs in AfterTestCommand
3971 Backport "Add missing [DoesNotReturn] annotations" from #3958
3976 Equivalency fallback for non-IComparable types can leave CollectionTally in corrupt state
3998 Eagerly determine when a set is unsortable
3999 Numeric comparison fails when it should succeed.
4000 OverflowException comparing large double values
4007 Eagerly detect sortable types for equivalency tests in 3.13.x
4030 IsEmpty doesn't work with new .NET6 PriorityQueue
4032 Tests won't run with an abstract base class that has a TestCaseFixtureSource
4033 Recognized private members in base class for Source attributes
4034 Improve method discovery and filtering performance
4041 Minimze empty array allocations via centralized helper for pre-net46
4043 Stop testing the framework against netcoreapp21 in v3.13 branch
4058 Remove TopLevel property from ValueMatchFilter
NUnit 3.13.2 - April 27, 2021
This release fixes a new issue with the FixtureLifeCycle attribute where IDisposable test fixtures were not being disposed properly. As always, @gleb-osokin has been a great help with this new feature.
It also fixes a long-standing performance issue with CollectionAssert.AreEquivalent and the CollectionEquivalentConstraint when comparing large collections. The deep comparison that NUnit performs on the two collections will always have a worst case bound of O(n^2) but we have optimized it so that the majority of use cases will be closer to O(n).
We've also made significant optimizations to the OR filters for selecting tests using their full name. This dramatically improves test performance for large code bases that use dotnet test. Thanks to @pakrym for his help with this.
Issues Resolved
2799 CollectionAssert.AreEquivalent is extremely slow
3589 File headers, copyrights, and licenses
3773 IDisposable not working with InstancePerTestCase
3779 Obsolete AreEqual methods with nullable numeric arguments for 3.13
3784 Build the v3.13-dev branch
... (truncated)
Commits
af8ca8b Merge pull request #4070 from nunit/release-3-13-3
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Bumps nunit from 3.13.1 to 3.13.3.
Release notes
Sourced from nunit's releases.
Changelog
Sourced from nunit's changelog.
... (truncated)
Commits
af8ca8b
Merge pull request #4070 from nunit/release-3-13-3380615e
Revert sdk version to build on AppVeyord05d9b4
Update copyright year25b376e
Update to the latest version of .NET 5e2eca31
Changes for the 3.13.3 releasec32c2e4
Merge pull request #4007 from stevenaw/3998-eager-icomparable-detection8297c3d
Merge pull request #4034 from lahma/test-case-perf-improvements-v3a19bc73
Merge pull request #4042 from stevenaw/centralize-array-emptycf2fa03
implement InFilter.AddToXmlde83329
move test case from OrFilterTests to InFilterTestsDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)