How did you initialize your model parameters?

PetarV- / GAT

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

https://petar-v.com/GAT/

MIT License

3.2k stars 644 forks source link

How did you initialize your model parameters? #18

Closed mufeili closed 5 years ago

mufeili commented 5 years ago

Hi, thank you for the great work and releasing your code. In the paper you mentioned that the model parameters were initialized with Glorot initialization, but I cannot find it in the code. As I'm not very familiar with TensorFlow, maybe I just missed that part. Could you please elaborate on how did you do this? Thank you!

PetarV- commented 5 years ago

Hi,

Thank you for the kind words, and your interest in GAT!

The initialisation is implicit---every layer we have used from tf.layers will utilise Glorot (Xavier) initialisation by default, without us having to do anything.

Thanks, Petar

mufeili commented 5 years ago

Got it, thanks a lot! @PetarV-