I have little confusion here. is self._W means total number of the word in the minibatch or total number of the word in the whole corpus? In an online setting we can't able to set self._w as the total number in corpus because for online we may not know how much token is there. can anyone suggest me properly what to set self._w for the online setting?
I have little confusion here. is self._W means total number of the word in the minibatch or total number of the word in the whole corpus? In an online setting we can't able to set self._w as the total number in corpus because for online we may not know how much token is there. can anyone suggest me properly what to set self._w for the online setting?