If the history context is larger than 512

amazon-science / chronos-forecasting

Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting

https://arxiv.org/abs/2403.07815

Apache License 2.0

2.03k stars 238 forks source link

If the history context is larger than 512 #38

Closed ForestsKing closed 3 months ago

ForestsKing commented 3 months ago

Does chronos truncate the history context if it is larger than 512? If it will, can I turn off this limitation.

abdulfatir commented 3 months ago

It does: https://github.com/amazon-science/chronos-forecasting/blob/96cedec3fa9795c9bd58650080643e2b68bd3a6e/src/chronos/chronos.py#L140-L141

You can modify the code yourself, if you'd like to test without truncation but we have not really tested this setting of training on a specific context length and testing on a larger one. I'm not sure if it would work. If you decide to give it a go, I would be happy to hear your thoughts/results.

ForestsKing commented 3 months ago

ok, thanks!