Error in some files - Githubissues

Hi Srikanth,

I am experiencing some errors with some AMIcorpus meetings. I have two types of errors:

Error aborting the process of the meeting, that is, I am getting only one output file named for example: EN2002b.out The error I am getting is below:

*** Error in `/idiap/temp/msrikanth/repo/idiap-aib-diarization-dimseng/src/diarization/cmake/diarizeme': free(): invalid next size (normal): 0x0000000000a42450 ***
scripts/run.diarizeme.qsub.sh: line 23: 31727 Aborted                 $diarizeme_bin --mfcc $fname 1.0 --recid $fileid --outdir $opdir --tmpdir $opdir -s $scpfile --beta $beta_val --nthread 1 > $opdir/$fileid.out

And the content of the file EN2002b.out is as follows

AIB diarization started at 412620 
 MFCC:   /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2002b/audio/EN2002b.fea  weight MFCC  1 

 Maximum Segment Duration 250 

 AIB is running with the following parameters

 Maximum number of clusters possible:       10
 Normalized Mutual Information threshold:       0.5
 Beta value:        10
 Number of threads:         1
 Reading and Processing the scp file 
number of segments inside = 411

The other type of errors is not resulting the job to fail, but resulting in very bad results (DER close to 50%). An example of this type of errors is below:


AIB diarization started at 412620 

MFCC:   /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea  weight MFCC  1 

Maximum Segment Duration 250 

AIB is running with the following parameters

Maximum number of clusters possible:       10
Normalized Mutual Information threshold:       0.5
Beta value:        10
Number of threads:         1

Reading and Processing the scp file 
number of segments inside = 1046
Number of vectors = 459253
Feat file /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea of type 0
Reading feature file /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea
frame dim: 60
num_vec = 459253
Attempting memory allocation.
Memory successully allocated.
Reading file ... 
all segments read 
Number of segments in the file = 2386
num_vec = 459253  idx = 0
compute features after: 360.412

The matrix seems ok
Final Matrix size after zero removal 2386 2347  
The initial MI values are: 2.42627 7.77737 6.6303 
Initializing the Delta -- Computing 2386 times 2386 Distances 
Running time 2120  

Now Clustering 

Size: 9 Ity: 0.40674 Ht: 1.795 Ity_div_Itx:  0.16764  Ht_div_Hx:   0.230797
Size: 8 Ity: 0.391269 Ht: 1.73898 Ity_div_Itx:  0.161264  Ht_div_Hx:   0.223595
Size: 7 Ity: 0.362831 Ht: 1.56077 Ity_div_Itx:  0.149543  Ht_div_Hx:   0.200681
Size: 6 Ity: 0.346579 Ht: 1.52719 Ity_div_Itx:  0.142845  Ht_div_Hx:   0.196363
Size: 5 Ity: 0.329093 Ht: 1.4868 Ity_div_Itx:  0.135638  Ht_div_Hx:   0.19117
Size: 4 Ity: 0.304532 Ht: 1.37854 Ity_div_Itx:  0.125514  Ht_div_Hx:   0.17725
Size: 3 Ity: 0.27046 Ht: 1.25452 Ity_div_Itx:  0.111472  Ht_div_Hx:   0.161304
Size: 2 Ity: 0.225623 Ht: 1.07816 Ity_div_Itx:  0.0929918  Ht_div_Hx:   0.138628
Size: 1 Ity: 0.142102 Ht: 0.566667 Ity_div_Itx:  0.0585682  Ht_div_Hx:   0.072861

Size: 0 Ity: 4.7339e-10 Ht: 4.83391e-13 Ity_div_Itx:  1.9511e-10  Ht_div_Hx:   6.21535e-14
Saving this solution 
0  4.7339e-10  2.42627  1.9511e-10  
1  0.142102  2.42627  0.0585682  
2  0.225623  2.42627  0.0929918  
3  0.27046  2.42627  0.111472  
4  0.304532  2.42627  0.125514  
5  0.329093  2.42627  0.135638  
6  0.346579  2.42627  0.142845  
7  0.362831  2.42627  0.149543  
8  0.391269  2.42627  0.161264  
9  0.40674  2.42627  0.16764  
Key to solution 10 NMI value0.5  
The clustering has finished. Now saving the solution in /idiap/temp/akomaty/AMI_prep_feat/result.dir/EN2005a.clust.out
...and saying goodbye

last speech frame = 529794 total number of speech frames = 459253 training the rkl hmm ERROR!!!! ERROR!!!! ERROR!!!! ERROR!!!! . . . ERROR!!!! ERROR!!!! Segmentation Over with Viterbi score = -2514638.750000 The htk file sample rate 100000 Diarization stopped at 412622
Running time 5886 seconds
compute features after: 360.412 aib clustering after: 4198.59 realignment after: 145.14


**P.S.: The number of lines mentioning ERROR!!!! is: 378898**

idiap / IBDiarization

Error in some files #6