fix batch_size > 1 bug using collate_fn - Githubissues

kamalkraj / e5-mistral-7b-instruct

Finetune mistral-7b-instruct for sentence embeddings

Apache License 2.0

61 stars 13 forks source link

fix batch_size > 1 bug using collate_fn #9

Closed sangzisen closed 2 months ago

sangzisen commented 4 months ago

remove data preprocess func
move data process into custom collate_fn
change default_collate_fn to custom collate_fn