search

NVlabs / RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"
Other
736 stars 31 forks source link

Training / Tuning the model #79

Open paul-mdt opened 2 months ago

paul-mdt commented 2 months ago

Hello ! Amazing work, I was wondering if it was possible to continue training the model on a different dataset (for domain transfer for example)?

mranzinger commented 2 months ago

Yep, it typically works really well too.

paul-mdt commented 2 months ago

Thanks ! What would you recommend ? Is there a way to train it in a self-supervised way without too much ressources ? Or should it only be fine-tuned on downstream tasks ?

mranzinger commented 2 months ago

I think I might be a bit confused by your question. The resource demand would likely depend on what application you have in mind, aside from you being able to now choose between a ViT-B, L, or H variant, which would affect resources. Could you elaborate on what you're wanting to accomplish?