search

thuml / Autoformer

About Code release for "Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting" (NeurIPS 2021), https://arxiv.org/abs/2106.13008
MIT License
2k stars 429 forks source link

Mask Mechanism #92

Closed xiaodong-chan closed 2 years ago

xiaodong-chan commented 2 years ago

The decoder has no implementation of mask mechanism. So are those parameters like 'x_mask' are redundant?

wuhaixu2016 commented 2 years ago

Yes, in Auto-Correlation we don't need mask. But if you want to process time series with missing data, you may need this parameter to mark the meaningless tokens.