search

alumae / kaldi-gstreamer-server

Real-time full-duplex speech recognition server, based on the Kaldi toolkit and the GStreamer framwork.
BSD 2-Clause "Simplified" License
1.07k stars 340 forks source link

Worker websocket closes prematurely after silence timeout reached #30

Open gpoole opened 9 years ago

gpoole commented 9 years ago

I have a 10 second silence timeout configured, which kicks in as expected, however when the worker is sending the final status message to the client the web socket seems to already be closed. It looks a lot like the websocket is being closed in the middle of the worker running finish_request, meaning guard_timeout is unable to send a STATUS_NO_SPEECH event (https://github.com/alumae/kaldi-gstreamer-server/blob/master/kaldigstserver/worker.py#L76) and neither the client nor master server are receiving it. The last event received by the client (browser) is the adaptation state success message (https://github.com/alumae/kaldi-gstreamer-server/blob/master/kaldigstserver/worker.py#L257).

worker-1.log:

   DEBUG 2015-10-11 05:40:18,230 Starting up worker 
2015-10-11 05:40:18 -    INFO:   decoder2: Creating decoder using conf: {'post-processor': "perl -npe 'BEGIN {use IO::Handle; STDOUT->autoflush(1);} s/(.*)/\\1./;'", 'logging': {'version': 1, 'root': {'level': 'DEBUG', 'handlers': ['console']}, 'formatters': {'simpleFormater': {'datefmt': '%Y-%m-%d %H:%M:%S', 'format': '%(asctime)s - %(levelname)7s: %(name)10s: %(message)s'}}, 'disable_existing_loggers': False, 'handlers': {'console': {'formatter': 'simpleFormater', 'class': 'logging.StreamHandler', 'level': 'DEBUG'}}}, 'use-nnet2': True, 'full-post-processor': './sample_full_post_processor.py', 'decoder': {'ivector-extraction-config': 'test/models/english/tedlium_nnet_ms_sp_online/conf/ivector_extractor.conf', 'num-nbest': 10, 'lattice-beam': 6.0, 'acoustic-scale': 0.083, 'do-endpointing': True, 'beam': 10.0, 'max-active': 10000, 'fst': 'test/models/english/tedlium_nnet_ms_sp_online/HCLG.fst', 'mfcc-config': 'test/models/english/tedlium_nnet_ms_sp_online/conf/mfcc.conf', 'use-threaded-decoder': True, 'traceback-period-in-secs': 0.25, 'model': 'test/models/english/tedlium_nnet_ms_sp_online/final.mdl', 'word-syms': 'test/models/english/tedlium_nnet_ms_sp_online/words.txt', 'endpoint-silence-phones': '1:2:3:4:5:6:7:8:9:10', 'chunk-length-in-secs': 0.25}, 'silence-timeout': 10, 'out-dir': 'tmp', 'use-vad': False}
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-silence-phones after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule1-must-contain-nonsilence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule1-min-trailing-silence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule1-max-relative-cost after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule1-min-utterance-length after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule2-must-contain-nonsilence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule2-min-trailing-silence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule2-max-relative-cost after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule2-min-utterance-length after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule3-must-contain-nonsilence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule3-min-trailing-silence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule3-max-relative-cost after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule3-min-utterance-length after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule4-must-contain-nonsilence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule4-min-trailing-silence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule4-max-relative-cost after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule4-min-utterance-length after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule5-must-contain-nonsilence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule5-min-trailing-silence after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule5-max-relative-cost after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::endpoint-rule5-min-utterance-length after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::feature-type after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::mfcc-config after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::plp-config after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::fbank-config after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::add-pitch after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::online-pitch-config after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::ivector-extraction-config after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::ivector-silence-weighting-silence-phones after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::ivector-silence-weighting-silence-weight after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::ivector-silence-weighting-max-state-duration after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::delta after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::max-mem after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::phone-determinize after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::word-determinize after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::minimize after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::beam after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::max-active after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::min-active after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::lattice-beam after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::prune-interval after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::determinize-lattice after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::beam-delta after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::hash-ratio after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::acoustic-scale after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::max-buffered-features after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::feature-batch-size after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::nnet-batch-size after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::max-loglikes-copy after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::decode-batch-sie after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'delta'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'max-mem'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'phone-determinize'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'word-determinize'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'minimize'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'beam'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'max-active'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'min-active'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'lattice-beam'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'prune-interval'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'determinize-lattice'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'beam-delta'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'hash-ratio'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: When installing property: type 'Gstkaldinnet2onlinedecoder' already has a property named 'acoustic-scale'
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::pad-input after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/decoder2.py:48: Warning: Attempt to add property Gstkaldinnet2onlinedecoder::max-nnet-batch-size after class was initialised
  self.asr = Gst.ElementFactory.make("kaldinnet2onlinedecoder", "asr")
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: ivector-extraction-config = test/models/english/tedlium_nnet_ms_sp_online/conf/ivector_extractor.conf
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: num-nbest = 10
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: lattice-beam = 6.0
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: acoustic-scale = 0.083
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: do-endpointing = True
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: beam = 10.0
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: max-active = 10000
2015-10-11 05:40:18 -    INFO:   decoder2: Setting decoder property: fst = test/models/english/tedlium_nnet_ms_sp_online/HCLG.fst
2015-10-11 05:40:31 -    INFO:   decoder2: Setting decoder property: mfcc-config = test/models/english/tedlium_nnet_ms_sp_online/conf/mfcc.conf
2015-10-11 05:40:31 -    INFO:   decoder2: Setting decoder property: traceback-period-in-secs = 0.25
2015-10-11 05:40:31 -    INFO:   decoder2: Setting decoder property: model = test/models/english/tedlium_nnet_ms_sp_online/final.mdl
2015-10-11 05:40:31 -    INFO:   decoder2: Setting decoder property: word-syms = test/models/english/tedlium_nnet_ms_sp_online/words.txt
2015-10-11 05:40:32 -    INFO:   decoder2: Setting decoder property: endpoint-silence-phones = 1:2:3:4:5:6:7:8:9:10
2015-10-11 05:40:32 -    INFO:   decoder2: Setting decoder property: chunk-length-in-secs = 0.25
2015-10-11 05:40:32 -    INFO:   decoder2: Created GStreamer elements
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstAppSrc object at 0x7fe68e966230 (GstAppSrc at 0x16609a0)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstDecodeBin object at 0x7fe68e966410 (GstDecodeBin at 0x16580b0)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstAudioConvert object at 0x7fe68e966320 (GstAudioConvert at 0x167bcb0)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstAudioResample object at 0x7fe68e9662d0 (GstAudioResample at 0x1688f10)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstTee object at 0x7fe68e9663c0 (GstTee at 0x1638170)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstQueue object at 0x7fe68e966280 (GstQueue at 0x168e1d0)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstFileSink object at 0x7fe68e966370 (GstFileSink at 0x1692830)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstQueue object at 0x7fe68e966460 (GstQueue at 0x168e4c0)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.Gstkaldinnet2onlinedecoder object at 0x7fe68e919370 (Gstkaldinnet2onlinedecoder at 0x16bc030)> to the pipeline
2015-10-11 05:40:32 -   DEBUG:   decoder2: Adding <__main__.GstFakeSink object at 0x7fe68e9193c0 (GstFakeSink at 0x16cb200)> to the pipeline
2015-10-11 05:40:32 -    INFO:   decoder2: Linking GStreamer elements
LOG (ComputeDerivedVars():ivector-extractor.cc:182) Computing derived variables for iVector extractor
LOG (ComputeDerivedVars():ivector-extractor.cc:203) Done.
2015-10-11 05:40:32 -    INFO:   decoder2: Setting pipeline to READY
2015-10-11 05:40:32 -    INFO:   decoder2: Set pipeline to READY
2015-10-11 05:40:32 -    INFO:   __main__: Opening websocket connection to master server
2015-10-11 05:40:32 -    INFO:   __main__: Opened websocket connection to server
2015-10-11 05:40:49 -   DEBUG:   __main__: <undefined>: Got message from server of type <class 'ws4py.messaging.TextMessage'>
2015-10-11 05:40:49 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Initializing request
2015-10-11 05:40:49 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Setting caps to audio/x-raw, layout=(string)interleaved, rate=(int)16000, format=(string)S16LE, channels=(int)1
2015-10-11 05:40:49 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Connecting audio decoder
2015-10-11 05:40:49 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Started timeout guard
2015-10-11 05:40:49 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Initialized request
2015-10-11 05:40:49 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:49 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Connected audio decoder
2015-10-11 05:40:50 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:50 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:50 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:50 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:50 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:50 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:50 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:50 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing (final=False) result..
2015-10-11 05:40:50 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing done.
2015-10-11 05:40:51 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:51 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:51 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:51 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:51 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:51 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:51 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:51 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:51 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:51 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the test
2015-10-11 05:40:51 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing (final=False) result..
2015-10-11 05:40:51 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing done.
2015-10-11 05:40:52 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:52 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the test
2015-10-11 05:40:52 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:52 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the test
2015-10-11 05:40:52 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:52 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the test
2015-10-11 05:40:52 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:52 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:52 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:52 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the test
2015-10-11 05:40:53 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:53 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:53 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:53 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got final result: the test
2015-10-11 05:40:53 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got full final result: {"status": 0, "total-length": 2.86, "result": {"final": true, "hypotheses": [{"transcript": "the test", "likelihood": 69.3736}, {"transcript": "a test", "likelihood": 67.7495}, {"transcript": "to test", "likelihood": 66.6572}, {"transcript": "test", "likelihood": 65.2246}, {"transcript": "but test", "likelihood": 64.5778}, {"transcript": "i test", "likelihood": 64.3957}, {"transcript": "one test", "likelihood": 64.1008}, {"transcript": "and test", "likelihood": 63.7347}, {"transcript": "that test", "likelihood": 63.4901}, {"transcript": "we test", "likelihood": 63.4253}]}, "segment-start": 0.0, "segment-length": 2.86}
2015-10-11 05:40:53 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Before postprocessing: {u'status': 0, u'total-length': 2.86, u'result': {u'hypotheses': [{u'likelihood': 69.3736, u'transcript': u'the test'}, {u'likelihood': 67.7495, u'transcript': u'a test'}, {u'likelihood': 66.6572, u'transcript': u'to test'}, {u'likelihood': 65.2246, u'transcript': u'test'}, {u'likelihood': 64.5778, u'transcript': u'but test'}, {u'likelihood': 64.3957, u'transcript': u'i test'}, {u'likelihood': 64.1008, u'transcript': u'one test'}, {u'likelihood': 63.7347, u'transcript': u'and test'}, {u'likelihood': 63.4901, u'transcript': u'that test'}, {u'likelihood': 63.4253, u'transcript': u'we test'}], u'final': True}, u'segment-length': 2.86, u'segment-start': 0.0}
2015-10-11 05:40:53 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing done.
2015-10-11 05:40:53 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: After postprocessing: {u'status': 0, u'total-length': 2.86, u'result': {u'hypotheses': [{u'likelihood': 69.3736, u'confidence': 1.6240999999999985, u'transcript': u'the test.'}], u'final': True}, u'segment-length': 2.86, u'segment-start': 0.0}
2015-10-11 05:40:53 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:53 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:53 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:53 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:53 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:53 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:53 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:54 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:54 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:54 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:54 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:54 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:54 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:55 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:55 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:55 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:55 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing (final=False) result..
2015-10-11 05:40:55 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing done.
2015-10-11 05:40:55 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:55 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:55 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:55 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:55 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:55 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:55 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:55 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got partial result: the
2015-10-11 05:40:56 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:56 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:56 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:56 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:56 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:56 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5946 to pipeline
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:57 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got final result: the act
2015-10-11 05:40:57 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got full final result: {"status": 0, "total-length": 5.63, "result": {"final": true, "hypotheses": [{"transcript": "the act", "likelihood": 42.8241}, {"transcript": "the", "likelihood": 42.7886}, {"transcript": "the and", "likelihood": 42.7387}, {"transcript": "a", "likelihood": 42.1951}, {"transcript": "the eye", "likelihood": 41.987}, {"transcript": "the that", "likelihood": 41.8408}, {"transcript": "a i", "likelihood": 41.573}, {"transcript": "the past", "likelihood": 41.3998}, {"transcript": "the <unk>", "likelihood": 41.0507}, {"transcript": "a and", "likelihood": 40.9692}]}, "segment-start": 2.86, "segment-length": 2.77}
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Before postprocessing: {u'status': 0, u'total-length': 5.63, u'result': {u'hypotheses': [{u'likelihood': 42.8241, u'transcript': u'the act'}, {u'likelihood': 42.7886, u'transcript': u'the'}, {u'likelihood': 42.7387, u'transcript': u'the and'}, {u'likelihood': 42.1951, u'transcript': u'a'}, {u'likelihood': 41.987, u'transcript': u'the eye'}, {u'likelihood': 41.8408, u'transcript': u'the that'}, {u'likelihood': 41.573, u'transcript': u'a i'}, {u'likelihood': 41.3998, u'transcript': u'the past'}, {u'likelihood': 41.0507, u'transcript': u'the <unk>'}, {u'likelihood': 40.9692, u'transcript': u'a and'}], u'final': True}, u'segment-length': 2.77, u'segment-start': 2.86}
2015-10-11 05:40:57 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Postprocessing done.
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: After postprocessing: {u'status': 0, u'total-length': 5.63, u'result': {u'hypotheses': [{u'likelihood': 42.8241, u'confidence': 0.03549999999999898, u'transcript': u'the act.'}], u'final': True}, u'segment-length': 2.77, u'segment-start': 2.86}
2015-10-11 05:40:57 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:57 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:58 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:58 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:58 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:58 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:40:58 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:58 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:59 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:59 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:40:59 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:59 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:59 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:40:59 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:59 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:40:59 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:40:59 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:40:59 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:00 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:00 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:00 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:00 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:00 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5946 to pipeline
2015-10-11 05:41:00 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:01 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:01 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:01 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:01 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:01 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:01 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:02 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:02 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:02 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:02 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:02 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:02 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:03 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:03 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:03 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:03 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:03 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:03 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:04 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:04 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:04 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:04 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:04 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:04 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:05 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:05 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:05 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:05 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:05 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:05 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:06 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:06 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:06 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:06 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:41:06 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:06 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:07 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:07 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:07 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:07 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:07 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:07 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Checking that decoder hasn't been silent for more than 10 seconds
2015-10-11 05:41:08 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8918 to pipeline
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:08 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:08 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 8916 to pipeline
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:08 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Got message from server of type <class 'ws4py.messaging.BinaryMessage'>
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer of size 5944 to pipeline
2015-10-11 05:41:08 -   DEBUG:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pushing buffer done
2015-10-11 05:41:08 - WARNING:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: More than 10 seconds from last decoder hypothesis update, cancelling
2015-10-11 05:41:08 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Master disconnected before decoder reached EOS?
2015-10-11 05:41:08 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending EOS to pipeline in order to cancel processing
2015-10-11 05:41:08 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Cancelled pipeline
2015-10-11 05:41:08 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Waiting for EOS from decoder
2015-10-11 05:41:09 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Pipeline received eos signal
2015-10-11 05:41:09 -    INFO:   decoder2: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Resetting decoder state
2015-10-11 05:41:09 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending adaptation state to client...
2015-10-11 05:41:09 -   DEBUG:      ws4py: Closing message received (1000) ''
2015-10-11 05:41:09 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Websocket closed() called
2015-10-11 05:41:09 -   DEBUG:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Websocket closed() finished
2015-10-11 05:41:09 -    INFO:   decoder2: <undefined>: Resetting decoder state
2015-10-11 05:41:09 -    INFO:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Finished waiting for EOS
2015-10-11 05:41:09 - WARNING:   __main__: c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Failed to send error event to master
2015-10-11 05:41:10 -    INFO:   __main__: Opening websocket connection to master server
2015-10-11 05:41:10 -    INFO:   __main__: Opened websocket connection to server

server.log:

   DEBUG 2015-10-11 05:40:18,221 Starting up server 
    INFO 2015-10-11 05:40:32,545 New worker available <__main__.WorkerSocketHandler object at 0x7f5681ab8150> 
    INFO 2015-10-11 05:40:32,570 New worker available <__main__.WorkerSocketHandler object at 0x7f5681ab8090> 
    INFO 2015-10-11 05:40:49,802 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: OPEN 
    INFO 2015-10-11 05:40:49,802 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Request arguments: content-type="audio/x-raw, layout=(string)interleaved, rate=(int)16000, format=(string)S16LE, channels=(int)1" 
    INFO 2015-10-11 05:40:49,803 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Using worker <__main__.DecoderSocketHandler object at 0x7f5681ab8650> 
    INFO 2015-10-11 05:40:49,803 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Using content type: audio/x-raw, layout=(string)interleaved, rate=(int)16000, format=(string)S16LE, channels=(int)1 
    INFO 2015-10-11 05:40:50,374 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:50,457 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:50,666 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:50,892 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:50,895 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending event {u'status': 0, u'segment': 0, u'result': {u'hypotheses': [{u'transcript': u'the.'}], u'final': Fa... to client 
    INFO 2015-10-11 05:40:51,172 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:51,428 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:51,678 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:51,908 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:51,910 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending event {u'status': 0, u'segment': 0, u'result': {u'hypotheses': [{u'transcript': u'the test.'}], u'final... to client 
    INFO 2015-10-11 05:40:52,185 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:52,461 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:52,660 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:52,985 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:53,193 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:53,353 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending event {u'status': 0, u'segment-start': 0.0, u'segment-length': 2.86, u'total-length': 2.86, u'result': ... to client 
    INFO 2015-10-11 05:40:53,509 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:53,670 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:54,034 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:54,203 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:54,530 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:54,708 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:55,082 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:55,209 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:55,254 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending event {u'status': 0, u'segment': 1, u'result': {u'hypotheses': [{u'transcript': u'the.'}], u'final': Fa... to client 
    INFO 2015-10-11 05:40:55,579 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:55,718 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:56,131 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:56,193 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:56,655 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:56,738 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:57,179 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:57,239 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5946 to worker 
    INFO 2015-10-11 05:40:57,479 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:57,733 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:57,887 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending event {u'status': 0, u'segment-start': 2.86, u'segment-length': 2.77, u'total-length': 5.63, u'result':... to client 
    INFO 2015-10-11 05:40:57,955 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:58,235 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:58,488 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:58,753 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:58,965 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:40:59,276 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:40:59,499 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:40:59,774 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:00,002 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:00,324 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:00,507 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:00,822 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5946 to worker 
    INFO 2015-10-11 05:41:01,012 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:01,373 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:01,517 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:01,871 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:02,018 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:41:02,421 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:02,496 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:02,946 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:03,033 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:03,470 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:41:03,526 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:03,995 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:04,078 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:04,267 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:04,547 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:41:04,799 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:05,050 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:05,277 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:05,567 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:41:05,807 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:06,064 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:06,312 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:06,616 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:06,815 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:41:07,113 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:07,323 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:07,665 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:07,801 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:08,189 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8918 to worker 
    INFO 2015-10-11 05:41:08,336 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:08,714 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
    INFO 2015-10-11 05:41:08,814 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 5944 to worker 
    INFO 2015-10-11 05:41:09,102 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Sending event {u'status': 0, u'adaptation_state': {u'type': u'string+gzip+base64', u'id': u'c0b969e3-7035-40a8-... to client 
    INFO 2015-10-11 05:41:09,103 Worker <__main__.WorkerSocketHandler object at 0x7f5681ab8090> leaving 
    INFO 2015-10-11 05:41:09,237 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Forwarding client message (<type 'str'>) of length 8916 to worker 
   ERROR 2015-10-11 05:41:09,238 Uncaught exception in /client/ws/speech 
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/tornado/websocket.py", line 415, in _run_callback
    callback(*args, **kwargs)
  File "/usr/lib/speakeasy/lib/kaldi-gstreamer-server/kaldigstserver/master_server.py", line 323, in on_message
    self.worker.write_message(message, binary=True)
  File "/usr/local/lib/python2.7/dist-packages/tornado/websocket.py", line 213, in write_message
    raise WebSocketClosedError()
WebSocketClosedError
    INFO 2015-10-11 05:41:09,238 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Handling on_connection_close() 
    INFO 2015-10-11 05:41:09,238 c0b969e3-7035-40a8-97e6-c5b0ed1b01b4: Closing worker connection 
    INFO 2015-10-11 05:41:10,106 New worker available <__main__.WorkerSocketHandler object at 0x7f56818664d0>
rohithkodali commented 8 years ago

i'm also having the same issue, do you got any fix for it.

DEBUG: main: : Got message from server of type <class ws4py.messaging.TextMessage'>

yifan commented 8 years ago

there is a timeout (default: 10s) for getting result updates (partial/final results) from decoder. If the decoder hasn't produce anything for more than 10 seconds, server assumes the worker is dead. Most likely, there is something wrong with the input or the model. You could increase the timeout threshold in configuration file if you think it is just because the decoding is slow.