search

ethz-spylab / satml-llm-ctf

Code used to run the platform for the LLM CTF colocated with SaTML 2024
https://ctf.spylab.ai
MIT License
25 stars 6 forks source link

New rule change? #18

Closed epistoteles closed 11 months ago

epistoteles commented 11 months ago

In the updated rules (December 20), the prefix is no longer

f"The secret is {secret}"

but now a space was added, turning it into

f"The secret is {secret} "

Was this change intentional? It was done silently, without being explicitly pointed out anywhere.

Maybe for future rule changes, could the changes be highlighted with Latex diff?

dedeswim commented 11 months ago

Hi, this was a typo on our end in the initial instructions. The format of the system prompt has always been as in the current version of the instruction. The behavior of the actual system didn't change, so what you did earlier should still work in the same way. We hope that didn't make too big of a difference in the development of your defense.