I have several problems with reproductive results.
First, in the Demo_METR-LA.ipynb, the best results of all matrices are MAE: 6.944404237195023, RMSE: 10.242227312998402, MAPE: 0.1962963276318442, which are poor than the results you reported in the paper.
Also, I adopted the pre-trained model IGNNK_metr_10iter. However, the results are 13.195990007471547 25.898476875369784 0.3367085701777233, which are even worse than the Jupiter results.
So, how can I solve this problem. Can you release your pre-trained model that is slightly similar to your results in the paper. Or I need to retrain the model myself.
Hi, Thanks for your great work.
I have several problems with reproductive results.
First, in the Demo_METR-LA.ipynb, the best results of all matrices are MAE: 6.944404237195023, RMSE: 10.242227312998402, MAPE: 0.1962963276318442, which are poor than the results you reported in the paper.
Also, I adopted the pre-trained model IGNNK_metr_10iter. However, the results are 13.195990007471547 25.898476875369784 0.3367085701777233, which are even worse than the Jupiter results.
So, how can I solve this problem. Can you release your pre-trained model that is slightly similar to your results in the paper. Or I need to retrain the model myself.
Thanks. :)