search

Unispac / Visual-Adversarial-Examples-Jailbreak-Large-Language-Models

Repository for the Paper (AAAI 2024, Oral) --- Visual Adversarial Examples Jailbreak Large Language Models
183 stars 16 forks source link

Question on extension to other VLM #2

Closed lizaitang closed 1 year ago

lizaitang commented 1 year ago

Dear Author, Your paper really helps, have you ever considering the difficulty of extending the work to other VLM model such as LLava?

Unispac commented 1 year ago

Hi,

We have recently extended our attacks to Instruct-BLIP, LLaVA (vicuna based) and LLaVA (llama2-based). Similar results are also observed. We would update our paper as well as the github repository in our next iteration. Please stay tuned!

We will also present this paper in ICML AdvML-Frontiers workshop on July 28. If you are attending, would be happy to chat more as well.

Best