Embeddings from lag-llama

time-series-foundation-models / lag-llama

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Apache License 2.0

1.08k stars 121 forks source link

Closed onchiptech closed 2 months ago

onchiptech commented 3 months ago

Hi,

I would like to know the exact location in the lag-llama source code of the last hidden state to capture embeddings.

Regards, Surendra

ashok-arjun commented 3 months ago

Hi, you could extract the embedding from the model in this line. The embedding dimension in the current model is 144.