zwbx / SHIFT-Continuous_Test_Time_Adaptation

22 stars 0 forks source link

Performance issue of Tent #9

Closed Cascol-Chen closed 1 year ago

Cascol-Chen commented 1 year ago

I find that Tent does not improve performance compared with source model, which contradicts to the paper in Figure 6. Could you further explain the difference?

zwbx commented 1 year ago

There may be some misunderstanding. This benchmark codebase is intended for the competition, not as an official repository for the original SHIFT paper. In our benchmark, there exist slight improvements comparing to baseline without any adaptation.