search

experimaestro / experimaestro-ir

IR module for experimaestro
GNU General Public License v3.0
11 stars 3 forks source link

Features/duo #4

Closed yzong12138 closed 1 year ago

yzong12138 commented 1 year ago

bug fixed for not using the segment id for the bert. bug fixed for concatenating the duobert tokens in a incorrect way bug NOT fixed yet for DataParallel() writing/reading wrong model in the DistributedHook add the training procedure for trec_car for the monobert. add the code for loading the model from huggingface for evaluation use (just a structure, maybe need to be deleted soon).

start to implement the code for splade.py

yzong12138 commented 1 year ago

bug fixed for not using the segment id for the bert. bug fixed for concatenating the duobert tokens in a incorrect way bug NOT fixed yet for DataParallel() writing/reading wrong model in the DistributedHook add the training procedure for trec_car for the monobert. add the code for loading the model from huggingface for evaluation use (just a structure, maybe need to be deleted soon).

start to implement the code for splade.py