THUDM / GraphMAE

GraphMAE: Self-Supervised Masked Graph Autoencoders in KDD'22
478 stars 75 forks source link

reproduction issue #46

Closed AaronNing closed 1 year ago

AaronNing commented 1 year ago

Hi,

Thanks for the great work but I am having trouble reproducing the results.

I ran (as you provided) python main_transductive.py --dataset cora --encoder gat --decoder gat --seed 0 --device 0 and got the following:

# Epoch 199: train_loss: 0.6322:  98%|███████████████████████████████████████████████████████████████████▉ | 197/200 [00:07<00:00, 38.22it/s]│    702 systemd-r  20   0 25792 14192  9632 S  0.0  0.0  0:02.36 /lib/systemd/systemd-resolved
# IGNORE: --- TestAcc: 0.4270, early-stopping-TestAcc: 0.4400, Best ValAcc: 0.4540 in epoch 9 ---                                            │    703 systemd-t  20   0 89376  6684  5824 S  0.0  0.0  0:00.29 /lib/systemd/systemd-timesyncd
# Epoch 199: train_loss: 0.6322: 100%|█████████████████████████████████████████████████████████████████████| 200/200 [00:07<00:00, 25.39it/s]│    708 root       20   0  5124   176     4 S  0.0  0.0  0:00.00 /usr/sbin/blkmapd
num parameters for finetuning: 435721                                                                                                        │    709 root       20   0  3104  2052  1884 S  0.0  0.0  0:00.00 /usr/sbin/rpc.idmapd
# Epoch: 29, train_loss: 1.5159, val_loss: 1.5887, val_acc:0.592, test_loss: 1.5832, test_acc: 0.5910: 100%|█| 30/30 [00:00<00:00, 50.10it/s]│    710 root       20   0  5460  2632  2208 S  0.0  0.0  0:00.00 /usr/sbin/nfsdcld
--- TestAcc: 0.5910, early-stopping-TestAcc: 0.6150, Best ValAcc: 0.6020 in epoch 25 ---                                                     │    711 systemd-t  20   0 89376  6684  5824 S  0.0  0.0  0:00.00 /lib/systemd/systemd-timesyncd
# final_acc: 0.5910±0.0000                                                                                                                   │    713 root       20   0  243M  8480  7212 S  0.0  0.0  0:02.24 /usr/libexec/accounts-daemon
# early-stopping_acc: 0.6150±0.0000

My env:

torch=2.0.1+cu117
dgl=1.1.0+cu118
ogb=1.3.6

Thanks!

AaronNing commented 1 year ago

And using the bash script solved this problem. : p