Hi, will the evaluation code (mentioned in Sec 4.1) be made open source?

ys-zong / VLGuard

[ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.

https://ys-zong.github.io/VLGuard/

45 stars 2 forks source link

Hi, will the evaluation code (mentioned in Sec 4.1) be made open source? #2

Closed ChnQ closed 3 months ago

ys-zong commented 6 months ago

Yes, I'm currently cleaning the code and will release them in the next a few weeks. Please stay tuned.

virajprabhu commented 4 months ago

Great work! Any updates on releasing the evaluation code so that we can report performance on VLGuard?

ys-zong commented 4 months ago

Hi, I've uploaded the evaluation code using LLaVA as an example. You can also easily integrate other models. Please let me know if you have any trouble running it.

virajprabhu commented 4 months ago

Great, thanks!