Batch Size for 24 GB VRAM

152334H / DL-Art-School

TorToiSe fine-tuning with DLAS

GNU Affero General Public License v3.0

205 stars 86 forks source link

Closed Snowad14 closed 1 year ago

Snowad14 commented 1 year ago

What batch size do you use on 24 GB of vram?

152334H commented 1 year ago

highest I've used is 128, which leaves lots of vram to spare in my experience

Plausibly this could be a lot higher if your wav files are very long

Snowad14 commented 1 year ago

Do you use gradient checkpointing?

152334H commented 1 year ago

yes I see no reason to disable it