QData / TextAttack

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
https://textattack.readthedocs.io/en/master/
MIT License
2.98k stars 397 forks source link

a bugs that occurred during the evaluation #788

Open jiangdaolime opened 7 months ago

jiangdaolime commented 7 months ago

When I used the model trained by the A2T attack to evaluate the robustness, the code used the other models to generate 1000 samples for evaluation. 1712895714705 Some of them, such as a2t and textflooer, can be run, but a2t-mlm and bae will get stuck at the normal point of generation. Stepping into debugging found that it was locked in the queue during parallel generation and caused the pause, but I don't know why it was locked, can you tell me why. f9f6371e3570ad5b28f29f39a79b2cf e26e46ee1edb02a11cce7d72fd189f5