search

VITA-Group / Nasty-Teacher

[ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Chenyu You, Xiaohui Xie, Zhangyang Wang
MIT License
81 stars 13 forks source link

About the setting. #15

Open kxgong opened 1 year ago

kxgong commented 1 year ago

Hi there, thanks for your great work!!! I have a question about the setting of this work. Does this work assume that the 'stealer' can access and only access the logits output of the teacher model? And the model resources like model structure and parameters are invisible?

HowieMa commented 1 year ago

Hi, thanks for your interest in our work. Your understanding is correct. We assume the teacher model is a black-box API and we can only access its input-output behavior.

kxgong commented 1 year ago

Thanks for your instant reply! Nasty teacher is a solid work!