Closed bokyeong1015 closed 1 year ago
@youngwanLEE, please find our response below:
Did you also face this problem?
We haven’t encountered such an error IndexError: index 63 is out of bounds for dimension 0 with size 63
Did you conduct any pre-processing of the LAION data??
We removed some problematic image-text pairs (empty text files and PIL-unreadable images); however, this led to different error messages from yours.
We’ve tried to reproduce this error (by changing batch sizes under a multi-gpu setting, adding empty lines in metadata.csv, using very long text prompts or multi-line prompts), but eventually failed to do so (no or different errors occurred).
Could you provide more context about this error? It would be very appreciated if you could generously share your update and/or solution to this issue.
@bokyeong1015 thanks for your effort :)
I finally solved this problem.
The problem was caused by empty text files in the dataset.
When I filtered the empty text pairs, the problem was solved.
From now on, I started to train models on larger datasets over 10M image-text pairs.
Thanks again :)
It would be ok to close this issue.
Great, thanks for sharing! Hope your training goes well :)
[Question]