The biggest highlight of this release if our new VSTest Adapter, which allows to run benchmarks as unit tests in your favorite IDE!
The detailed guide can be found here.
This release also includes to a minor bug fix that caused incorrect job id generation: fixed job id generation (#2491).
Also, the target framework in the BenchmarkDotNet templates was bumped to .NET 8.0.
You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer.zip.
To run performance benchmark, you can download the attached PerfBenchmark.zip.
Commits
2c9ba5d Adding new APIs to avoid passing in allowed special tokens (#27)
512d432 Fix encodeTrim* on special strings with repeat tokens (#26)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore major version` will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
- `@dependabot ignore minor version` will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
- `@dependabot ignore ` will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
- `@dependabot unignore ` will remove all of the ignore conditions of the specified dependency
- `@dependabot unignore ` will remove the ignore condition of the specified dependency and ignore conditions
Bumps the all group with 10 updates:
1.13.21.14.11.5.11.6.017.8.017.9.03.1.13.2.03.1.13.2.022.6.023.1.00.13.100.13.121.3.21.3.31.2.141.2.151.0.81.0.9Updates
PolySharpfrom 1.13.2 to 1.14.1Release notes
Sourced from PolySharp's releases.
Commits
a7a92a9Merge pull request #91 from piotrstenke/patch-1e811138Fix typos in PolyfillsGenerator.cs8759578Merge pull request #92 from sliekens/bugfix/inline-array-attribute-visibility15de11dFix InlineArrayAttribute visibility2a6e35eMerge pull request #81 from Sergio0694/dev/net8-polyfillsd171c2eRemove unnecessary [UnmanagedCallersOnly] constructorc06aad4Add InlineArrayAttribute polyfill90c196aAdd unit tests for new polyfill types897ed98Update language version in readme filesf19ef6cAdd type forwarding test for [RequiresLocation]Updates
H.Resources.Generatorfrom 1.5.1 to 1.6.0Commits
Updates
Microsoft.NET.Test.Sdkfrom 17.8.0 to 17.9.0Release notes
Sourced from Microsoft.NET.Test.Sdk's releases.
Commits
a77b8d5Update dependencies from https://dev.azure.com/devdiv/DevDiv/_git/vs-code-cov...60eca4bDisable testhost prestart (#4833) (#4836)053d711Replaced obsolete NuGetAuthenticate@0 with NuGetAuthenticate@1 (#4800)f33b3e4Fixed version in tests (#4790)f8d273cChanged pre-release label version (#4786)2cda152Update dependencies from https://dev.azure.com/devdiv/DevDiv/_git/vs-code-cov...0b98146Update dependencies from https://dev.azure.com/devdiv/DevDiv/_git/vs-code-cov...e017f62Update dependencies from https://dev.azure.com/devdiv/DevDiv/_git/vs-code-cov...4572ac3Update dependencies from https://dev.azure.com/devdiv/DevDiv/_git/vs-code-cov...9ba4078[main] Update dependencies from dotnet/arcade (#4767)Updates
MSTest.TestAdapterfrom 3.1.1 to 3.2.0Release notes
Sourced from MSTest.TestAdapter's releases.
Changelog
Sourced from MSTest.TestAdapter's changelog.
... (truncated)
Commits
8c0b19d[main] Update dependencies from dotnet/arcade (#2157)a58adbcUpdate dependencies from https://github.com/microsoft/testanywhere bu… (#2156)1243bfcMerge pull request #2155 from microsoft/locfiles/04a38180-a207-44ac-b5c1-d094...df3f1efLocalized file check-in by OneLocBuild Task: Build definition ID 1218: Build ...5e08dc3Simplify version regex patterndb27b1b[main] Update dependencies from microsoft/testanywhere (#2153)00333e1Add some tests back pressure for msbuild (#2152)761b4ccFix telemetry tests57043a3Fix diag test459a5e6Fix expected logUpdates
MSTest.TestFrameworkfrom 3.1.1 to 3.2.0Release notes
Sourced from MSTest.TestFramework's releases.
Changelog
Sourced from MSTest.TestFramework's changelog.
... (truncated)
Commits
8c0b19d[main] Update dependencies from dotnet/arcade (#2157)a58adbcUpdate dependencies from https://github.com/microsoft/testanywhere bu… (#2156)1243bfcMerge pull request #2155 from microsoft/locfiles/04a38180-a207-44ac-b5c1-d094...df3f1efLocalized file check-in by OneLocBuild Task: Build definition ID 1218: Build ...5e08dc3Simplify version regex patterndb27b1b[main] Update dependencies from microsoft/testanywhere (#2153)00333e1Add some tests back pressure for msbuild (#2152)761b4ccFix telemetry tests57043a3Fix diag test459a5e6Fix expected logUpdates
Verify.MSTestfrom 22.6.0 to 23.1.0Commits
da8db15add missing scrubbing overloads (#1138)dfa2b38remvoe SourceLink6b98e30Docs changes5d6238aBump MSTest.TestAdapter from 3.1.1 to 3.2.0 in /src (#1136)0fd7a73docsf488b0dUpdate Verify.ClipboardAccept.csproj2e502caDiffEngine 15.2.0 (#1135)787b3f7Docs changesd2f5c92Bump Verify.Expecto from 22.11.5 to 23.0.0 in /src (#1133)895ec48docsUpdates
BenchmarkDotNetfrom 0.13.10 to 0.13.12Release notes
Sourced from BenchmarkDotNet's releases.
... (truncated)
Commits
cdce32fPrepare v0.13.12 changelog0159b88[docs] Update vstest2990951[Bug Fix] Custom SimpleJob Id ignored (#2491)06fb242Use different FQNs for parameterized cases in TestAdapter, fix #2494b67b6b1Update pack files layout for BenchmarkDotNet.TestAdapter, fix #24929f74923[build] Add test-pack job in run-tests workflow, see #24928b6badb[build] In the release workflow, automatically generate an announcement discu...5c46537[build] Bump Octokit: 9.0.0->9.1.041b23b7Update default framework version to net8.0 (LTS)91f3f7eAdd a VSTest Adapter (#2438)Updates
Microsoft.DeepDev.TokenizerLibfrom 1.3.2 to 1.3.3Release notes
Sourced from Microsoft.DeepDev.TokenizerLib's releases.
Commits
2c9ba5dAdding new APIs to avoid passing in allowed special tokens (#27)512d432FixencodeTrim*on special strings with repeat tokens (#26)3c6fcb9Fix caching for other APIs as well (#23)6c7d0d2fix cache miss problem (#22)fa7f2a1Update README.md6a7beb4Update tokenizer-ts-release.ymld8eac55Create npm-publish-github-packages.ymlc24bcbdUpdate tokenizer-ts-release.yml to publish to npmjsab64002remove node-fetch (#21)1387fdeFix link in README (#19)Updates
SharpTokenfrom 1.2.14 to 1.2.15Release notes
Sourced from SharpToken's releases.
Commits
e47dc0enew mapping (#28)Updates
TiktokenSharpfrom 1.0.8 to 1.0.9Commits
f499c7cupdate readmee0b73d4Merge pull request #16 from winzig/openai-new-embeddingsc434f1eAdding support for OpenAI's new embedding models: text-embedding-3-small and ...Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show