search

dotnet / machinelearning

ML.NET is an open source and cross-platform machine learning framework for .NET.
https://dot.net/ml
MIT License
8.92k stars 1.86k forks source link

AccessViolationException when running Microsoft.ML.Scenarios.ScenariosTests.TestRegressionScenario #6960

Open michaelgsharp opened 5 months ago

michaelgsharp commented 5 months ago

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=529419 Build error leg or test failing: Microsoft.ML.Tests.WorkItemExecution Pull request: https://github.com/dotnet/machinelearning/pull/6954

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Microsoft.ML.Trainers.SdcaTrainerBase`3.TrainWithoutLock",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Test is failing with the following exception. https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-machinelearning-refs-pull-6954-merge-cc648714fbed40e1bb/Microsoft.ML.Tests/1/console.34966131.log?helixlogtype=result

Starting test: Microsoft.ML.Scenarios.ScenariosTests.TestRegressionScenario

Unhandled Exception: System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
   at System.Numerics.Tensors.TensorPrimitives.<Aggregate>g__Vectorized|53_1[TBinaryOperator,TAggregationOperator](Single& xRef, Single& yRef, UIntPtr remainder, TBinaryOperator binaryOp, TAggregationOperator aggregationOp)
   at System.Numerics.Tensors.TensorPrimitives.Aggregate[TBinaryOperator,TAggregationOperator](ReadOnlySpan`1 x, ReadOnlySpan`1 y, TBinaryOperator binaryOp, TAggregationOperator aggregationOp)
   at System.Numerics.Tensors.TensorPrimitives.Dot(ReadOnlySpan`1 x, ReadOnlySpan`1 y)
   at Microsoft.ML.Internal.CpuMath.CpuMathUtils.DotProductDense(ReadOnlySpan`1 left, ReadOnlySpan`1 right, Int32 count) in D:\a\_work\1\s\src\Microsoft.ML.CpuMath\CpuMathUtils.cs:line 194
   at Microsoft.ML.Numeric.VectorUtils.DotProduct(VBuffer`1& a, VBuffer`1& b) in D:\a\_work\1\s\src\Microsoft.ML.Data\Depricated\Vector\VectorUtils.cs:line 53
   at Microsoft.ML.Trainers.SdcaTrainerBase`3.WDot(VBuffer`1& features, VBuffer`1& weights, Single bias) in D:\a\_work\1\s\src\Microsoft.ML.StandardTrainers\Standard\SdcaBinary.cs:line 319
   at Microsoft.ML.Trainers.SdcaTrainerBase`3.TrainWithoutLock(IProgressChannelProvider progress, Factory cursorFactory, Random rand, IdToIdxLookup idToIdx, Int32 numThreads, DualsTableBase duals, Single[] biasReg, Single[] invariants, Single lambdaNInv, VBuffer`1[] weights, Single[] biasUnreg, VBuffer`1[] l1IntermediateWeights, Single[] l1IntermediateBias, Single[] featureNormSquared) in D:\a\_work\1\s\src\Microsoft.ML.StandardTrainers\Standard\SdcaBinary.cs:line 839
   at Microsoft.ML.Trainers.SdcaTrainerBase`3.<>c__DisplayClass13_3.<TrainCore>b__5(Int32 j) in D:\a\_work\1\s\src\Microsoft.ML.StandardTrainers\Standard\SdcaBinary.cs:line 639
   at System.Threading.Tasks.Parallel.<>c__DisplayClass17_0`1.<ForWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
   at System.Threading.Tasks.Task.Execute()
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
   at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
   at System.Threading.ThreadPoolWorkQueue.Dispatch()

Report

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 0