search

gzerveas / mvts_transformer

Multivariate Time Series Transformer, public version
MIT License
718 stars 169 forks source link

Normalizer will normalize the test data with mean and std of test unless it is used on train data before #26

Closed Wensi-Tang closed 1 year ago

gzerveas commented 1 year ago

Hello, yes, the assumption is that the model will first be trained, or otherwise training set statistics will be provided, before proceeding to evaluation on the test set.

Wensi-Tang commented 1 year ago

Thanks so much! You are doing it well, but I just think this might be dangerous for someone to reproduce the result.

gzerveas commented 1 year ago

This is a good point. Maybe it would be best to add a warning, in case someone uses --test_only option but does not use the --norm_from option.