salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method
BSD 3-Clause "New" or "Revised" License
1.53k stars 195 forks source link

Pre-training on custom datasets #77

Closed xiezhiweihk closed 2 years ago

xiezhiweihk commented 2 years ago

Hello, I'm a deep learning beginner.

If the dataset is small, can I train my own dataset? I tried my own dataset and got the following error.

header, total_time_str, total_time / len(iterable))) ZeroDivisionError: float division by zero

LiJunnan1992 commented 2 years ago

That means your dataset is too small to fit in a batch. You can reduce the batch size.

xiezhiweihk commented 2 years ago

Thanks