请问这个d_ff是什么啊

KimMeen / Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

https://arxiv.org/abs/2310.01728

Apache License 2.0

1.02k stars 179 forks source link

Closed liuwj2000 closed 1 month ago

liuwj2000 commented 1 month ago

请问超参数里面的这个d_ff是什么啊

kwuking commented 1 month ago

d_ff来自于dimension_feedforward，是指transformer中的feedforward中间层的维度，这里是也是一个维度变换的中间维度，从d_model变换到d_ff