Closed alirezamshi-zz closed 3 years ago
Hi @alirezamshi ,
As mentioned in the report, we trained 8 Graphormer models using 8-fold cross-validation, and additional 2 Graphormer models using whole data.
The checkpoint you are using now is all_fold_seed0.ckpt
, please try to use the cross-validation split here here and use the correct checkpoint instead of these begin with all_fold
.
Best, Chengxuan
You can alternatively uncomment L71-86, and comment L89-96. And remember to load the correct checkpoint.
By the way, in the code, I simply set fold index the same as seed.
Got it. Thanks.
@chengxuanying , great work, i have a problem, if we want to reproduce validate MAE 0.1234 (single model) with training from scratch, which branch (main or ogb-lsc) we should use?
Hi,
Thanks for your interesting work. I have a problem regarding the evaluation. I downloaded your checkpoints from here, then I run the following command as mentioned in the Readme (for
all_fold_seed0
checkpoint):The output log is:
I assumed that I should get results near Table 1 "validate MAE column", but it's different from that. Do I miss something?
Thanks for your help.