Xiaohan-Chen / TFPred

An official code for paper: TFPred: Learning discriminative representations from unlabeled data for few-label rotating machinery fault diagnosis
MIT License
25 stars 3 forks source link

about prediction head Q(·) #3

Open blackjiang-xin opened 2 weeks ago

blackjiang-xin commented 2 weeks ago

您好,我想请问为什么频域的特征还需要经过一个prediction head Q(·),怎么确保经过prediction head Q(·)的特征和zt还具有相关性。

Xiaohan-Chen commented 1 week ago

The motivation for using the prediction head Q(·) from the paper "Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning," in which the authors used a prediction head to predict the augmented offline gadgets.

In our work, we use the time encoder and the frequency encoder to extract time and frequency domain features, respectively. To model the correlation between time domain features and frequency domain features, we use the prediction head Q(·) to project the frequency domain features into the time domain, and apply the cross-correlation loss function to guide the model to learn time and frequency features with correlation from raw unlabeled signals. We hope the comments can address your concern.