search

thuml / OpenLTM

Open-Source Implementations of Large Time-Series Models
MIT License
42 stars 4 forks source link

Pre-training #3

Open ZChaowen opened 3 days ago

ZChaowen commented 3 days ago

模型的Pre-training使用的是单变量数据吗？我看代码中UTSD_Npy的数据获取是单变量的。

Levi-Ackman commented 2 days ago

一般TimeLLM都是单变量预训练的，然后想预测多变量的时候使用channel-independent来重复预测N个目标变量的值

ZChaowen commented 2 days ago

@Levi-Ackman 那用基于Timer-XL训练的大模型，进行zero-shot依旧仅支持单变量输入了。

hvlgo commented 23 hours ago

Timer-XL supports multivariable pre-training. We plan to train it on large-scale multivariable dataset, so stay tuned!