Success rate equals 0 for MHM attack on CodeGPT model

CGCL-codes / Attack_PTMC

The dataset, source code and the results of our ESEC/FSE 2023 paper "An Extensive Study on Adversarial Attack against Pre-trained Models of Code".

MIT License

11 stars 2 forks source link

Success rate equals 0 for MHM attack on CodeGPT model #3

Closed hluu2224 closed 10 months ago

hluu2224 commented 1 year ago

Hi,

Since I could not find "../../../dataset/preprocess/test_subs_summary_sampled.jsonl" (in attack_mhm.py) available in the repo, I used this file "../../../dataset/preprocess/test_subs_summary.jsonl". Then, I got the success rate is 0.

I would like to ask if it is possible to upload test_subs_summary_sampled.jsonl.

Thank you,

xhdu commented 10 months ago

I have added this file. Your success rate of 0 may be caused by other factors, please check carefully.