search

gabrielloye / Attention_Seq2seq-Translation

34 stars 23 forks source link

Why using tanh function #7

Open karimmahalian opened 1 year ago

karimmahalian commented 1 year ago

Hi,

Thank u for this great repo. Could you please tell me why using tanh here

x = torch.tanh(self.fc_hidden(hidden[0])+self.fc_encoder(encoder_outputs))

Many thanks in advance