NullReferenceException in ToTwoDimensionalArray

[atruskie]

Testcase: Y:\TheNatureConservency\Indonesia\25\20160727_continuous\20160727_094400_continuous1.wav

2016-09-30T09:14:43.1789400+10:00 [1] INFO  CleanLogger - 
2016-09-30T09:14:43.1789400+10:00 [1] INFO  CleanLogger - START PROCESSING RESULTS ...
2016-09-30T09:14:43.7724210+10:00 [1] FATAL AnalysisPrograms.MainEntry - Unhandled exception ->
System.AggregateException: One or more errors occurred. ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Parallel.PartitionerForEachWorker[TSource,TLocal](Partitioner`1 source, ParallelOptions parallelOptions, Action`1 simpleBody, Action`2 bodyWithState, Action`3 bodyWithStateAndIndex, Func`4 bodyWithStateAndLocal, Func`5 bodyWithEverything, Func`1 localInit, Action`1 localFinally)
   at System.Threading.Tasks.Parallel.ForEachWorker[TSource,TLocal](IEnumerable`1 source, ParallelOptions parallelOptions, Action`1 body, Action`2 bodyWithState, Action`3 bodyWithStateAndIndex, Func`4 bodyWithStateAndLocal, Func`5 bodyWithEverything, Func`1 localInit, Action`1 localFinally)
   at System.Threading.Tasks.Parallel.ForEach[TSource](IEnumerable`1 source, Action`3 body)
   at System.EnumerableExtensions.ToTwoDimensionalArray[T,TBase](IList`1 items, Dictionary`2 selectors, TwoDimensionalArray dimensionality) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 135
   at AnalysisPrograms.Acoustic.SummariseResults(AnalysisSettings settings, FileSegment inputFileSegment, EventBase[] events, SummaryIndexBase[] indices, SpectralIndexBase[] spectralIndices, AnalysisResult2[] results) in C:\Work\Github\audio-analysis\AudioAnalysis\AnalysisPrograms\AcousticIndices.cs:line 517
   at AnalysisPrograms.AnalyseLongRecordings.AnalyseLongRecording.Execute(Arguments arguments) in C:\Work\Github\audio-analysis\AudioAnalysis\AnalysisPrograms\AnalyseLongRecordings\AnalyseLongRecording.cs:line 283
   at System.Dynamic.UpdateDelegates.UpdateAndExecuteVoid2[T0,T1](CallSite site, T0 arg0, T1 arg1)
   at PowerArgs.ArgAction`1.Invoke() in c:\Work\Software Dev\Github\PowerArgs\PowerArgs\ArgAction.cs:line 38
   at AnalysisPrograms.MainEntry.Main(String[] args) in C:\Work\Github\audio-analysis\AudioAnalysis\AnalysisPrograms\MainEntry.cs:line 53
---> (Inner Exception #0) System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )<---

---> (Inner Exception #1) System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )<---

---> (Inner Exception #2) System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )<---

---> (Inner Exception #3) System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )<---

2016-09-30T09:14:43.7904321+10:00 [1] FATAL AnalysisPrograms.MainEntry - 

==> Inner exception:
System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
2016-09-30T09:14:43.7914329+10:00 [1] FATAL AnalysisPrograms.MainEntry - 

==> Inner exception:
System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
2016-09-30T09:14:43.7914329+10:00 [1] FATAL AnalysisPrograms.MainEntry - 

==> Inner exception:
System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
2016-09-30T09:14:43.7914329+10:00 [1] FATAL AnalysisPrograms.MainEntry - 

==> Inner exception:
System.NullReferenceException: Object reference not set to an instance of an object.
   at System.EnumerableExtensions.<>c__DisplayClass4_0`2.<ToTwoDimensionalArray>b__0(KeyValuePair`2 kvp, ParallelLoopState state, Int64 index) in C:\Work\Github\audio-analysis\Acoustics\Acoustics.Shared\Extensions\EnumerableExtensions.cs:line 113
   at System.Threading.Tasks.Parallel.<>c__DisplayClass42_0`2.<PartitionerForEachWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
2016-09-30T09:14:43.7914329+10:00 [1] INFO  LogFileOnly - ERRORLEVEL: 1000

[atruskie]

Further details:

• the problem happens with an out of data IndexPropertiesConfig.yml
• in these cases, the values for the missing properties get calculated for the first minute only - subsequent minutes are not calculated for some reason and that produces the nulls
• the problem happens in sequential mode as well as parallel
• the test file is dead quiet! The index generation code skips evaluation for minuted with low average signal amplitude. Because there are missing index properties values the Ridge indices don't get initialized with a non-null value.
• solution: change SpectralIndexValues' constructor to initialize all fields to 0 filled array - and IFF an index properties is available, then change the default.