In your model, you randomly select clip image features according to the proposal's class, however, for novel proposals, we only know they are novel, but we do not know which specific novel class they belong to, did you actually classify these proposals using CLIP? More specifically, how to generate the ``instances_train2017_seen_2_proposal.json'' file that annotates classes even for novel proposals?
In your model, you randomly select clip image features according to the proposal's class, however, for novel proposals, we only know they are novel, but we do not know which specific novel class they belong to, did you actually classify these proposals using CLIP? More specifically, how to generate the ``instances_train2017_seen_2_proposal.json'' file that annotates classes even for novel proposals?