wanghao9610 / OV-DINO

Official implementation of OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusion
https://wanghao9610.github.io/OV-DINO
Apache License 2.0
205 stars 10 forks source link

训练很慢 #21

Closed zuoshaobo closed 1 month ago

zuoshaobo commented 1 month ago

finetune的时候,很慢,有办法提高速度吗?我是固定几个目标的检测,是不是text的特征可以预先生成好?

wanghao9610 commented 1 month ago

训练慢主要是所有的模型权重都需要更新,你可以考虑在ovdino/projects/ovdino/configs/ovdino_swin_tiny224_bert_base_ft_custom_24ep.py L37下面添加下面的代码:

model.language_backbone.is_freeze=True

固定住text encoder的参数。

zuoshaobo commented 1 month ago

好的,谢谢