search

GestaltCogTeam / BasicTS

A Fair and Scalable Time Series Forecasting Benchmark and Toolkit.
https://ieeexplore.ieee.org/document/10726722/
Apache License 2.0
717 stars 115 forks source link

some issue about model performance #100

Closed chenywu closed 3 months ago

chenywu commented 11 months ago

The models trained in this repository perform much better than the models trained in other repositories. For example, Graph Wavenet in this repository has a mae of 14.65 on the PEMS08 dataset, while Graph Wavenet in another repository has a mae of 18.28 on the PEMS08 dataset. what have you done to improve the accuracy?

zezhishao commented 11 months ago

You can refer to our paper to find the reasons for inconsistent performance. Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysis.