search

wzh9969 / contrastive-htc

This repository implements a contrastive learning model for hierarchical text classification. This work has been accepted as the long paper "Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification" in ACL 2022.
MIT License
131 stars 30 forks source link

请问温度系数越大效果更好是为什么呢？有什么理论支撑吗 #13

Closed amal-spec closed 2 years ago

amal-spec commented 2 years ago

如题。We also find that a higher tau (e.g. tau=2) is beneficial but we keep it to for simplicity.请问是什么原因呢？温度系数越大不是越将所有负样本视为一致了吗，为何效果更佳呢?

wzh9969 commented 2 years ago

这是调参的发现，没有理论支撑，因此并没有在文章中提及。