trapoom555 / Language-Model-STS-CFT

Improving Text Embedding of Language Models Using Contrastive Fine-tuning
60 stars 7 forks source link

Preprocess data loader with tokenization #11

Closed trapoom555 closed 6 months ago

trapoom555 commented 6 months ago

Can train with preprocessed data