search

cleverhans-lab / entangled-watermark

44 stars 10 forks source link

Watermark not successful in extracted model #1

Open Shawn-Shan opened 3 years ago

Shawn-Shan commented 3 years ago

Hi,

Really nice work. but when I ran the code using MNIST dataset, it prints out the following:

Victim Model || validation accuracy: 0.9820713140070438, watermark success: 1.0 Extracted Model || validation accuracy: 0.981770833954215, watermark success: 0.03013390302658081， baseline: 0.006696428571428571

Does this means the watermark fail to transfer to the victim model? If so, what could have gone wrong? I ran the code with all default settings and seed.

Shawn-Shan commented 3 years ago

I ran a couple more time. The results fluctuate quite a bit. I got a 98% success and 63% success.

Jimntu commented 2 years ago

Same problem, the watermark success of the extracted model in mnist or fashion mnist dataset never exceeds 2 percent. Other datasets fluctuate a lot, ranging from less than 10 percent to 80 percent. Anyone know why is that?

Sun-Jiatuhao commented 1 year ago

Same problem，the watermark success of the extracted model in mnist dataset is very low and the rate of success is very unstable.