githubharald
commented
3 years ago you have to evaluate the output of the RNN with softmax applied, and then feed this into the decoder. Something like that (not tested):
- After this line, define a new variable self.rnn_out_sm = tf.nn.softmax(self.ctcIn3dTBC, axis=2)
- In the infer function, evaluate the variable defined before, rnn_out_sm_numpy = self.sess.run(self.rnn_out_sm, feedDict)
- Create the word beam search object only once! So e.g. in the
__init__function of the Model - Then, feed the evaluated numpy array (rnn_out_sm_numpy) to the compute function
jjsr
Dear Sir, Thank you for making it compatible along with windows , Your kind suggestion is required to implement it in SimpleHTR code --wordbeamsearch option-- 1) I followed the steps of read me at successful upto getting the output same as testPybind.py(Since windows does not support custom tf operation as per read me i followed purenumpy instruction)
Code snippet of SimpleHTR-->Model.py ################################## word_beam_search_module = tf.load_op_library('TFWordBeamSearch.so') chars = str().join(self.charList) wordChars = open('../model/wordCharList.txt').read().splitlines()[0] corpus = open('../data/corpus.txt').read()
decode using the "Words" mode of word beam search
self.decoder =word_beam_search_module.word_beam_search(tf.nn.softmax(self.ctcIn3dTBC, dim=2), 50, 'Words', 0.0, corpus.encode('utf8'), chars.encode('utf8'), wordChars.encode('utf8'))
################################# What should I replace it with to integrate CTCWordBeamSearch with SimpleHTR
Note- Initially i have tried to replace it with WordBeamSearch() , got confused with what to feed at my second try I try to convert tf.nn.softmax(self.ctcIn3dTBC, dim=2) into np.array(tf.nn.softmax(self.ctcIn3dTBC, dim=2)) results an error ** called testPybind() with above parameters results in error ..,, Please may guide to which direction go next