KimMeen / Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"
https://arxiv.org/abs/2310.01728
Apache License 2.0
1.02k stars 179 forks source link

Make a prediction and plot the results after training #74

Closed brunodifranco closed 1 month ago

brunodifranco commented 2 months ago

I've finished training the model (with GPT2), and I have the model saved, as shown below:

image

How can I load to model back, make a prediction and then plot ? like so:

image

59592-9 commented 2 months ago

Hello, can their model be successfully configured? If possible, what is the minimum level of GPU required

brunodifranco commented 2 months ago

Hello, can their model be successfully configured? If possible, what is the minimum level of GPU required

I managed to run it in a RTX 3050 Laptop GPU 4GB, but I had to tweak a bunch of parameters and use GPT2, instead of bigger models.

Huang-Jingxiang commented 2 months ago

Maybe this will help. https://towardsdatascience.com/time-llm-reprogram-an-llm-for-time-series-forecasting-e2558087b8ac

JackKoLing commented 1 month ago

Keep an eye on the demo version

lehazare commented 1 month ago

Hello @brunodifranco, do you think it would be possible for you to share the GPT2 tweak you mentioned ? @JackKoLing what do you mean ?

JackKoLing commented 1 month ago

Hello @brunodifranco, do you think it would be possible for you to share the GPT2 tweak you mentioned ? @JackKoLing what do you mean ?

I mean waiting for the plot demo..

JackKoLing commented 1 month ago

I've finished training the model (with GPT2), and I have the model saved, as shown below:

image

How can I load to model back, make a prediction and then plot ? like so:

image

just get all input batch, GT, and outputs on test datasets, and then you can get the MAE, MSE and plot by batch_x, GT, and outputs.