HLT example : ASR processing failed (HCompV)

AAROC / CODE-RADE

Website, documentation and such for the CODE-RADE project

http://www.africa-grid.org/CODE-RADE

Apache License 2.0

5 stars 5 forks source link

HLT example : ASR processing failed (HCompV) #67

Open brucellino opened 8 years ago

brucellino commented 8 years ago

HCompV -A -T 1 -C /nfs/home-GLITE/sagrid005/home_cream_125980864/CREAM125980864/cvn_vectors -k */mfccs/%%%_*.mfc -q v -S /nfs/home-GLITE/sagrid005/home_cream_125980864/all.mfccs.lst 
HMM Def Error: GetToken: Symbol expected at line 1/col 2/char 1 in /nfs/home-GLITE/sagrid005/home_cream_125980864/CREAM125980864/data/mfccs/isindebele_001_03.mfc
  ERROR [+7050]  HMError:
HMM Def Error: LoadHMMSet: GetToken failed at line 1/col 0/char -1 in /nfs/home-GLITE/sagrid005/home_cream_125980864/CREAM125980864/data/mfccs/isindebele_001_03.mfc
  ERROR [+7050]  HMError:
  ERROR [+2028]  Initialise: LoadHMMSet failed
 FATAL ERROR - Terminating program HCompV
Extracting features: <MFCC_0_D_A_Z>
HCopy -A -T 1 -C /nfs/home-GLITE/sagrid005/home_cream_125980864/CREAM125980864/config/hcopy.cmvn.conf -S lists/hcopylist.lst 
  ERROR [+6376]  LoadCMeanVector: non-matching mask */audio/???/%%%_*.wav
 FATAL ERROR - Terminating program HCopy
bash: /nfs/home-GLITE/sagrid005/home_cream_125980864

brucellino commented 8 years ago

There appears to be an error with the way the MFC is created. Comparing the execution between the ASR template and the CODE-RADE HTK example, the execution seems similar:

template : bash $DIR_SRC/cmn.sh $FLAG $LIST 2>&1 | tee -a $DIR_EXP/log/cmn.log
example : bash cmn.sh $FLAG $LIST 2>&1 | tee -a log/cmn.log

The command that is executed on the WN is : HCompV -A -T 1 +++ -C +++ /nfs/home-GLITE/sagrid005/home_cream_125980864/CREAM125980864/cvn_vectors -k "*/mfccs/%%%_*.mfc" -q v -S /nfs/home-GLITE/sagrid005/home_cream_125980864/all.mfccs.lst

brucellino commented 8 years ago

The diff between the template cmn script and the one in contrib is :

< LOCAL_MFCC_LIST=$DIR_SCRATCH/all.mfccs.lst
---
> LOCAL_MFCC_LIST=all.mfccs.lst
79c79
< bash $DIR_SRC/create_configs.sh hcopy $LOCAL_CFG_HCOPY
---
> ./create_configs.sh hcopy $LOCAL_CFG_HCOPY
100,101c100,101
< bash $DIR_SRC/create_configs.sh hcopy $LOCAL_CFG_HCOPY
< echo "HPARM:CMEANDIR  = '$CMEANDIR'" >> $LOCAL_CFG_HCOPY 
---
> ./create_configs.sh hcopy $LOCAL_CFG_HCOPY
> echo "HPARM:CMEANDIR  = '$CMEANDIR'" >> $LOCAL_CFG_HCOPY
111c111
< bash $DIR_SRC/check_exit_status.sh $0 $?
---
> ./check_exit_status.sh $0 $?

There was also an error in the cmn.sh script, which was fixed in cf88cd1

brucellino commented 8 years ago

For reference,the config that is generated is :

CEPLIFTER       =       22
ENORMALISE      =       FALSE
NUMCEPS         =       12
NUMCHANS        =       26
PREEMCOEF       =       0.97
SAVECOMPRESSED  =       FALSE
SAVEWITHCRC     =       FALSE
SOURCEFORMAT    =       WAVE
TARGETKIND      =       MFCC_0_D_A_Z
TARGETRATE      =       100000.0
USEHAMMING      =       TRUE
WINDOWSIZE      =       250000.0
ZMEANSOURCE     =       TRUE
LOFREQ          =       150
HIFREQ          =       4000
HPARM:CMEANDIR  = '/nfs/home-GLITE/sagrid005/home_cream_036166732/CREAM036166732/cmn_vectors'
HPARM:CMEANMASK = '*/audio/???/%%%_*.wav'
HPARM:VARSCALEDIR  = '/nfs/home-GLITE/sagrid005/home_cream_036166732/CREAM036166732/cvn_vectors'
HPARM:VARSCALEMASK = '*/audio/???/%%%_*.wav'
HPARM:VARSCALEFN   = '/nfs/home-GLITE/sagrid005/home_cream_036166732/CREAM036166732/cvn_vectors/globvariance'