ScottLogic / prompt-injection

Application which investigates defensive measures against prompt injection attacks on an LLM, with a focus on the exposure of external tools.
MIT License
11 stars 9 forks source link

Prevent radio buttons from selecting when focused by keyboard #859

Open pmarsh-scottlogic opened 4 months ago

pmarsh-scottlogic commented 4 months ago

Bug report

Description

Regarding radio buttons under sandbox -> Defence Configuration -> Prompt enclosure, if you keyboard-navigate through the options (using the up/down arrows), the button you have just navigated to will automatically get selected. What should happen instead is it doesn't get selected until the user presses the space key.

Reproduction steps

Steps to reproduce the behaviour:

  1. Load the app and go to sandbox
  2. Open Defence Configuration and Prompt Enclosure
  3. Keyboard-navigate to the radio buttons
  4. Use the up-down arrow keys to navigate to different options
  5. Observe that the focused option gets selected

Expected behaviour

A focused radio button should not get selected UNTIL the user presses the space key

Screenshots

These radio buttons 'ere

Image

Software (please complete the following information):

Additional context

Add any other context about the problem here.

Acceptance criteria

GIVEN Keyboard navigating through the Prompt Enclosure radio buttons part of the Defence Configuration panel. WHEN User uses the up/down arrow key to focus a different radio button THEN the new radio button is focused AND NOT selected

GIVEN User has focused radio button AND not selected it yet WHEN they press the space key THEN the focused radio button becomes selected

pmarsh-scottlogic commented 4 months ago

On further research, this is default and expected behaviour of radio buttons. It is unfortunate that changing the option triggers a chat message and a network call. If we want to fix this, I suggest we use some other kind of input, rather than making the radiobutton behave differently to convention

pmarsh-scottlogic commented 4 months ago

Another idea is we could send the network request and add the info message on blur. So: