muzairkhattak / multimodal-prompt-learning

[CVPR 2023] Official repository of paper titled "MaPLe: Multi-modal Prompt Learning".
https://muzairkhattak.github.io/multimodal-prompt-learning/
MIT License
619 stars 43 forks source link

How to compute the harmonic mean #3

Closed jingzhengli closed 1 year ago

jingzhengli commented 1 year ago

Thanhs for sharing the code. After I obtain the results of base classes and novel classes, how to compute the harmonic mean?

hanoonaR commented 1 year ago

Hi @jingzhengli,

Thanks for showing interest in our work.

The harmonic mean is calculated as, $(2 \times Base{acc} \times Novel{acc}) / (Base{acc} + Novel{acc})$

Thank you.

dneirfi commented 1 year ago

Hi, Thanks for sharing the nice work! @jingzhengli @hanoonaR

I have a question about calculating the harmonic mean.

Base_acc and Nov_acc are the best accuracy in three runs or average in three runs?

Thank you.

hanoonaR commented 1 year ago

Hi @dneirfi ,

Please note that we report the average over three runs both in Base_acc and Novel_acc, following the general few-shot experimental settings. Hope it is clear. Thank you.