search

zwbx / SHIFT-Continuous_Test_Time_Adaptation

21 stars 0 forks source link

Performance issue of Tent #9

Closed Cascol-Chen closed 11 months ago

Cascol-Chen commented 11 months ago

I find that Tent does not improve performance compared with source model, which contradicts to the paper in Figure 6. Could you further explain the difference?

zwbx commented 11 months ago

There may be some misunderstanding. This benchmark codebase is intended for the competition, not as an official repository for the original SHIFT paper. In our benchmark, there exist slight improvements comparing to baseline without any adaptation.