KindXiaoming / pykan

Kolmogorov Arnold Networks
MIT License
13.59k stars 1.19k forks source link

how to train own data for multivarite time series forcasting task? #1

Open luoolu opened 2 months ago

luoolu commented 2 months ago

MLPs already used in time-series forecasting

KindXiaoming commented 2 months ago

Interesting application! Both MLPs and KANs are models which cannot do time series immediately. Like one needs to turn MLPs to RNNs/LSTMs/transformers first, we also need to turn KANs into counterparts, which are not supported yet, but hopefully not too hard to implement with KANs as building blocks!

luoolu commented 2 months ago

Yes, I understand. I look forward to the application of KAN in this time multivariate sequence prediction task. Thank you very much

Somdudewillson commented 2 months ago

Technically, there is the basic method of simply providing a fixed window to the network, which is one I've been experimenting with as part of trying to get a feel for KANs. (Kaggle notebook here if you're curious.)

yuedajiong commented 2 months ago

Years ago, I designed a TNN (Temporal Neural Network) based on the concept of Fourier-series. It was intended for time series prediction and anomaly detection, considering that the composition of a time series includes: trend, various periods, and noise. The trend component was calculated using moving averages at different scales, while fitting for multiple periods could be achieved through TNN. The core of TNN involved introducing sin and cos functions as activation functions, with the option to include coefficients to represent amplitude and frequency variations.

2017wxyzwxyz commented 1 month ago

@Somdudewillson,May I ask, based on your previous experience, has KAN significantly improved the prediction accuracy of time series data compared to other models such as LSTM?