search

getao / icae

The repo for In-context Autoencoder
Creative Commons Zero v1.0 Universal
54 stars 2 forks source link

Does pretrain.py in code v2 support batch_size>1? Why do I get an error when I use Batch_size larger than 1 #16

Open WUHU-G opened 1 month ago

getao commented 1 month ago

yes, v2 implementation now only supports batch=1 because we didn't observe throughput improvement after increasing batch size.

v1 doesn't have this constraint.