Hardware configurations for fine-tuning?

invictus717 / MetaTransformer

Meta-Transformer for Unified Multimodal Learning

https://arxiv.org/abs/2307.10802

Apache License 2.0

1.52k stars 114 forks source link

Hardware configurations for fine-tuning? #58

Closed tctco closed 1 year ago

tctco commented 1 year ago

Hi! I'm very interested in your research project and wish to fine-tune the meta-transformer on my own dataset (mostly multi-modal medical data). Could you provide a (minimal and recommended) hardware configuration for this purpose?

Thanks!

invictus717 commented 1 year ago

Thank you for your interest! If you wish to fine-tune our pretrained weights on your own dataset, I think 1 GPU card is enough.