TextAttack π is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
I'm experiencing unusual results with the custom fine-tuned model textattack/roberta-base-SST-2. The clean accuracy is significantly lower than expected, at 50.69%. I've included the attack results below, which show a low accuracy under attack and a high number of skipped attacks. I'd appreciate it if you could look into this issue.
I'm also encountering an issue with the bert-base-uncased model fine-tuned on several datasets. It suddenly behaves abnormally. I've tried reinstalling TextAttack, but the problem persists.
I'm experiencing unusual results with the custom fine-tuned model
textattack/roberta-base-SST-2
. The clean accuracy is significantly lower than expected, at 50.69%. I've included the attack results below, which show a low accuracy under attack and a high number of skipped attacks. I'd appreciate it if you could look into this issue.