search

dotnet / machinelearning

ML.NET is an open source and cross-platform machine learning framework for .NET.
https://dot.net/ml
MIT License
8.92k stars 1.86k forks source link

EnglishRoberta is not thread-safe #7005

Closed stephentoub closed 4 months ago

stephentoub commented 4 months ago

_mergeRanks is mutated as part of encoding: https://github.com/dotnet/machinelearning/blob/4635a862ddd21b3e7de0404f73a897fecb2011a1/src/Microsoft.ML.Tokenizers/Model/EnglishRoberta.cs#L591

stephentoub commented 4 months ago

cc: @tarekgh