search

luyug / Condenser

EMNLP 2021 - Pre-training architectures for dense retrieval
Apache License 2.0
243 stars 23 forks source link

Hi, i got this problem when pre-training Condenser. I try several version of transformer to fix but it didn't work. Can you help me please #12

Closed PNMinh286 closed 2 years ago

PNMinh286 commented 2 years ago

image

luyug commented 2 years ago

It looks like you didn't point the code to the proper training data directory.

PNMinh286 commented 2 years ago

It looks like you didn't point the code to the proper training data directory. Thank you for answering. I try ver 4.2.0 and it worked

lvzii commented 2 years ago

Function _remove_unused_columns(in latest transformers's trainer.py ) will set dataset to None. So higher version transformers doesn't work.