search

THUDM / HGB

Revisiting, benchmarking, and refining Heterogeneous Graph Neural Networks.
305 stars 47 forks source link

The random seed problem in experimental setting #17

Open wjwangppt opened 2 years ago

wjwangppt commented 2 years ago

Dear author: I noticed that the code you provide didn't fix the random seed. Can you provide the detail random seed corresponding to the tabular in the paper? I think it will bring the deviation of experimental results because the validation set is split in code, and different seed will cause different results. Thanks a lot if you provide the random seed your benchmark set.

1049451037 commented 2 years ago

We have already considered the random deviation by repeatedly running the code five times. The results in the tabular is the average and standard deviation of 5 times running.

wjwangppt commented 2 years ago

We have already considered the random deviation by repeatedly running the code five times. The results in the tabular is the average and standard deviation of 5 times running.

Thanks

NovelinUp commented 2 years ago

That mean use the seed 1 in the code or can set other seed each run? @1049451037