search

lxuechen / private-transformers

A codebase that makes differentially private training of transformers easy.
https://arxiv.org/abs/2110.05679
Apache License 2.0
159 stars 23 forks source link

VMAE Hugging Face Transformer is not supported #43

Open izakariyya opened 1 month ago

izakariyya commented 1 month ago

privacy_engine = PrivacyEngine( File "/home/idris/.local/lib/python3.10/site-packages/private_transformers/privacy_engine.py", line 176, in init raise ValueError( ValueError: Model type <class 'transformers.models.videomae.modeling_videomae.VideoMAEForVideoClassification'> is not supported. Please file an issue if you want this model to be added. Currently supported transformers are: (<class 'transformers.models.openai.modeling_openai.OpenAIGPTLMHeadModel'>, <class 'transformers.models.openai.modeling_openai.OpenAIGPTDoubleHeadsModel'>, <class 'transformers.models.gpt2.modeling_gpt2.GPT2LMHeadModel'>, <class 'transformers.models.gpt2.modeling_gpt2.GPT2DoubleHeadsModel'>, <class 'transformers.models.bert.modeling_bert.BertForSequenceClassification'>, <class 'transformers.models.roberta.modeling_roberta.RobertaForSequenceClassification'>, <class 'transformers.models.albert.modeling_albert.AlbertForSequenceClassification'>, <class 'transformers.models.bart.modeling_bart.BartForConditionalGeneration'>, <class 'transformers.models.t5.modeling_t5.T5ForConditionalGeneration'>, <class 'transformers.models.opt.modeling_opt.OPTForCausalLM'>, <class 'transformers.models.vit.modeling_vit.ViTForImageClassification'>, <class 'transformers.models.deit.modeling_deit.DeiTForImageClassification'>, <class 'transformers.models.beit.modeling_beit.BeitForImageClassification'>)"

izakariyya commented 1 month ago

Please add this hugging face transformer model to the privacy engine.