search

SalesforceAIResearch / uni2ts

[ICML2024] Unified Training of Universal Time Series Forecasting Transformers
Apache License 2.0
612 stars 49 forks source link

Embeddings from MOIRAI #32

Closed thisthq closed 1 month ago

thisthq commented 2 months ago

Hi,

I would like to know how to extract embeddings of the last hidden state to capture embeddings from your model.

Regards, thq

gorold commented 1 month ago

We currently don't support this function out of the box, but you can extract the representations from this line: https://github.com/SalesforceAIResearch/uni2ts/blob/ce27c2f9a0c6ee9119997e8ef0026388f143dcd6/src/uni2ts/model/moirai/module.py#L108