About metrics - Githubissues

JiazuoYu / MoE-Adapters4CL

Code for paper "Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters" CVPR2024

119 stars 6 forks source link

Closed boringKey closed 2 months ago

boringKey commented 2 months ago

Excuse me, how do you calculate the three metrics: Transfer, Last, and Average? Could you briefly explain with some related code?

JiazuoYu commented 2 months ago

Hello,

Our metrics adhere to the settings defined by ZSCL, and the figure of ZSCL may help facilitate your understanding:

Additionally, we use Excel sheets for the specific calculations:

reference: (ZSCL) Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models