muzairkhattak / multimodal-prompt-learning

[CVPR 2023] Official repository of paper titled "MaPLe: Multi-modal Prompt Learning".
https://muzairkhattak.github.io/multimodal-prompt-learning/
MIT License
578 stars 42 forks source link

MaPLE zero shot ability #71

Closed zbb1111 closed 5 days ago

zbb1111 commented 3 weeks ago

Thank you very much for your tremendous contribution. As a beginner, I am not very familiar with some aspects and I greatly need your help. I hope you have time to reply to me. Thank you! For the clip model, I can directly use its zero shot ability to implement classification tasks on my own dataset. I would like to ask if it is also possible to directly use the trained MaPLE and then use the zero shot ability on my own dataset? What operations are required? 1.How do I need to train MaPLE, what changes do I need to make, and on what dataset do I need to train?

  1. Which files do I need to use?
muzairkhattak commented 2 weeks ago

Hi @zbb1111,

Thank you for showing interest in MaPLe !

Regarding your queries, please note the following:

1) I would like to ask if it is also possible to directly use the trained MaPLE and then use the zero shot ability on my own dataset? Yes you can use MaPLe to directly evaluate it on your dataset. You will only need to set up your own dataset first so that the repository can load your dataset. Please checkout previous closed issues in how you can define your own dataset in this repository. After that, you can simply use cross-dataset evaluation instructions (in RUN.md) to evaluate trained MaPLe on your own dataset.

2) How do I need to train MaPLE, what changes do I need to make, and on what dataset do I need to train? Please refer to the instructions provided at RUN.md on training MaPLe.

3) Which files do I need to use? Again, all instructions have been provided in RUN.md.

Let us know if you still encounter any issue. Thank you and kind regards!

muzairkhattak commented 5 days ago

Hi @zbb1111,

I am closing the issue now. Feel free to reopen it if there are still any queries.