search

fpgaminer / joytag

The JoyTag Image Tagging Model
Apache License 2.0
400 stars 25 forks source link

Great work. Will you release finetune code? #7

Closed LianghuiGuo closed 3 weeks ago

LianghuiGuo commented 6 months ago

Do you have plans to release code for finetuning?

fpgaminer commented 6 months ago

Thank you. I'll try to get my training code cleaned up and released when I have a chance.

hussamsh commented 5 months ago

I would also be interested in some instruction about how to finetune this model and how to add more tags to top_tags.txt.

fpgaminer commented 3 months ago

Training code has been added: https://github.com/fpgaminer/joytag/tree/main/training

The training script supports a finetune-path argument so it can load a pretrained checkpoint. All the dataset processing scripts are in fused-dataset folder.

So for finetuning, I'd just get the data into the right format based on the data processing scripts, and then the training script with a finetune-path argument should do the trick.

As for adding tags for a finetune run, you'd probably need to modify the code slightly to resize the pretrained model's head.