daniel-gallo / naraim

3 stars 0 forks source link

Check probe batch size 512 vs 1024 #21

Open robertdvdk opened 5 months ago

robertdvdk commented 5 months ago

AIM uses a batch size of 1024 for finetuning their probe, we use 512. We should check whether 1024 improves performance.