search

LAION-AI / CLAP

Contrastive Language-Audio Pretraining
https://arxiv.org/abs/2211.06687
Creative Commons Zero v1.0 Universal
1.36k stars 133 forks source link

Training time to recreate #103

Open david-rx opened 1 year ago

david-rx commented 1 year ago

Hello, I am trying to assess feasibility of continued training of a CLAP model. On your report of training on a single A100 on Clotho, https://stability.wandb.io/clap/clap/reports/CLAP-trained-on-Clotho-dataset--VmlldzoyNzY?accessToken=c0erq9hhp7h880jclihd9j9if679s6bylwto33vo14yo5jg40ppe38qeoafoonpz, the timing metrics are not shown (e.g. train/batch_time.) Can you share how long it takes approximately to train on the Clotho dataset or generally? Thank you!

lukewys commented 1 year ago

If I remember correctly, the training time was several hours (4-6 hours, maybe). It is not a big dataset.

Best