Closed WenzhengZhang closed 2 years ago
@WenzhengZhang You can find an updated version of the file here: https://huggingface.co/datasets/sentence-transformers/embedding-training-data/resolve/main/msmarco-triplets.jsonl.gz
Not that his file is in jsonl format, while the linked script expects tsv. Hence, you need to update you script how the triplets are loaded
Better (updated) training scripts can be found here: https://github.com/UKPLab/sentence-transformers/tree/master/examples/training/ms_marco
Thanks for your help!
Thanks for sharing your work! I fould the triplets_url here in train_msmarco_v2 is stale. Could you please share this ms marco triplets file? Thanks!