[KTLO-4] OOM error in qgen

UKPLab / gpl

Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval" https://arxiv.org/abs/2112.07577

Apache License 2.0

324 stars 37 forks source link

[KTLO-4] OOM error in qgen #27

Closed kwang2049 closed 2 years ago

kwang2049 commented 2 years ago

Previous code does not detect OOM error in QGen, which might be due to large QPP or batch size

modified: gpl/toolkit/qgen.py: Added try catch new file: tests/unit/test_qgen.py: Added test