ljwztc / CLIP-Driven-Universal-Model

[ICCV 2023] CLIP-Driven Universal Model; Rank first in MSD Competition.
Other
565 stars 67 forks source link

Inference with pre-trained model? #32

Closed fipeop closed 1 year ago

fipeop commented 1 year ago

I am trying to run inference in an external dataset using the pre-trained weights. However, both test.py and pred_pseudo.py refer to resume checkpoint: ./out/Nvidia/old_fold0/aepoch_500.pth

Is this on purpose or are you planning to upload the checkpoint?

kretes commented 1 year ago

Have you downloaded checkpoints linked in https://github.com/ljwztc/CLIP-Driven-Universal-Model#model and put correct one at the path it's expecting it?

That's not an official answer, just what I think is required.

fipeop commented 1 year ago

Yes, those are the weight files .pt, but the --resume option in both test.py and pred_pseudo.py seems to refer to a .pth checkpoint file. As the inference script is written now, you need it seems.

ljwztc commented 1 year ago

Hi, @kretes is right. Download the checkpoint from link and resume the pth using --resume. ./out/Nvidia/old_fold0/aepoch_500.pth is just used in our server.

fipeop commented 1 year ago

Yes, it worked with the new checkpoint and some modification of the loading approach.