search

UKPLab / gpl

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577
Apache License 2.0
315 stars 39 forks source link

[KTLO-4] OOM error in qgen #27

Closed kwang2049 closed 1 year ago

kwang2049 commented 1 year ago

Previous code does not detect OOM error in QGen, which might be due to large QPP or batch size

modified: gpl/toolkit/qgen.py: Added try catch new file: tests/unit/test_qgen.py: Added test