search

ethz-spylab / satml-llm-ctf

Code used to run the platform for the LLM CTF colocated with SaTML 2024
https://ctf.spylab.ai
MIT License
25 stars 6 forks source link

[API support] List the chat id by defense #58

Closed persistz closed 10 months ago

persistz commented 10 months ago

Hi,

Could we add a API to support list/get the chat_id by defense? Now we can only get the chat info and id by exhaustive or precise search. For a team with multiple members, it is difficult to record each chat id. I would like to be able to see if a teammate has a chat record on a certain defense.

Thanks.

dedeswim commented 10 months ago

Just to clarify, you would like to get what chats have been created by you and your team members for a given defense submission?

persistz commented 10 months ago

Just to clarify, you would like to get what chats have been created by you and your team members for a given defense submission?

Yes, I think this allows us to continue attacking on the chat created by my teammates without being -50 for creating new chat.

dedeswim commented 10 months ago

Ok, I will look into that, but we won't deploy anything for the next ~24 hours to prevent disrupting what we expect to be the busiest time for the eval phase. Meanwhile, please coordinate with your teammates to prevent double chats.

persistz commented 10 months ago

Thanks. BTW, could the /api/v1/chat/attack/{id} return secret id?

I have successfully completed the attack on an old chat id, but I cannot see the secret id so cannot submit. . .

dedeswim commented 10 months ago

Both changes will be online at 16 UTC (i.e., 37 minutes from now)

dedeswim commented 10 months ago

Both features are up and running now. Feel free to re-open if they don't work