dotnet / machinelearning-modelbuilder

Simple UI tool to build custom machine learning models.
Creative Commons Attribution 4.0 International
266 stars 56 forks source link

Invalid call to 'GetValue' when Training Named Entity Recognition Data #2888

Open Hargravejason opened 8 months ago

Hargravejason commented 8 months ago

System Information (please complete the following information):

Describe the bug

To Reproduce Steps to reproduce the behavior:

  1. Select scenario
  2. Select Environment (both CPU and GPU have error)
  3. Add data
  4. Train

Expected behavior Training complete and moved to Evaluate section

Screenshots image

Additional context Error log: at Microsoft.ML.DataViewSchema.Annotations.GetValue[TValue](String kind, TValue& value) at Microsoft.ML.Data.SchemaAnnotationsExtensions.GetKeyValues[TValue](Column column, VBuffer1& keyValues) at Microsoft.ML.TorchSharp.NasBert.NerTrainer.Trainer.GetRowCountAndSetLabelCount(IDataView input) at Microsoft.ML.TorchSharp.TorchSharpBaseTrainer2.TrainerBase..ctor(TorchSharpBaseTrainer2 parent, IChannel ch, IDataView input, String modelUrl) at Microsoft.ML.TorchSharp.NasBert.NasBertTrainer2.NasBertTrainerBase..ctor(TorchSharpBaseTrainer2 parent, IChannel ch, IDataView input, String modelUrl) at Microsoft.ML.TorchSharp.NasBert.NerTrainer.CreateTrainer(TorchSharpBaseTrainer2 parent, IChannel ch, IDataView input) at Microsoft.ML.TorchSharp.TorchSharpBaseTrainer2.Fit(IDataView input) at Microsoft.ML.Data.EstimatorChain1.Fit(IDataView input) at Microsoft.ML.AutoML.SweepablePipelineRunner.Run(TrialSettings settings) at Microsoft.ML.AutoML.SweepablePipelineRunner.RunAsync(TrialSettings settings, CancellationToken ct) at Microsoft.ML.AutoML.AutoMLExperiment.d24.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Microsoft.ML.ModelBuilder.AutoMLService.Experiments.NamedEntityRecognitionExperiment.d13.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/Experiments/NamedEntityRecognitionExperiment.cs:line 133 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Microsoft.ML.ModelBuilder.AutoMLEngine.d_21.MoveNext() in //src/Microsoft.ML.ModelBuilder.AutoMLService/AutoMLEngineService/AutoMLEngine.cs:line 199

Files: NERKeyMap.txt NER_Data.txt

Note: Data shortened to 1 training item for example, training data has 2000+ items over all, issue occurs on any number of items.

LittleLittleCloud commented 8 months ago

@zewditu Can you take a look