Closed ryanleary closed 7 years ago
Use threads to parallelize decoder either at utterance (ie item in batch) and/or beam level.
Now OBE. Decodes are parallelized by one thread per utterance in a batch.
Use threads to parallelize decoder either at utterance (ie item in batch) and/or beam level.