longzw1997 / Open-GroundingDino

This is the third party implementation of the paper Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection.
MIT License
420 stars 65 forks source link

Add support for LoRA finetuning #81

Open zappy586 opened 4 months ago

zappy586 commented 4 months ago

@SahilCarterr I am looking for a way to train few-shot adapters for GDINO using LoRA. I tried loading this particular implementation using LoRA adapters but it simply doesn't work. I think its because some layers are implemented in C++/CUDA. It would be great if you could demonstrate how to load this model with LoRA in an example training script Thanks!