search

kevinduh / san_mrc

Stochastic Answer Networks (SAN) for Machine Reading Comprehension
BSD 3-Clause "New" or "Revised" License
149 stars 47 forks source link

I wonder why do log_softmax twice on the prediction logits? #16

Closed lixinsu closed 5 years ago

lixinsu commented 5 years ago

As depicted in code bellow . https://github.com/kevinduh/san_mrc/blob/1deb1b3e9e1f2399f3a16f3bf4be9db44f5d10f6/src/san.py#L105 . https://github.com/kevinduh/san_mrc/blob/1deb1b3e9e1f2399f3a16f3bf4be9db44f5d10f6/src/model.py#L92 .

lixinsu commented 5 years ago

Is this a special procedure for SAN module?

namisan commented 5 years ago

It is only to make the api consistence, which is output of logits.