rishikapadia7 / AvraLabsEyeControl

Mouse replacement software to use computers with your eyes with support of a compatible Tobii Eye Tracker.
Apache License 2.0
11 stars 2 forks source link

New feature: Click and Hold (Text Selection) #1

Open rishikapadia7 opened 4 years ago

rishikapadia7 commented 4 years ago

Currently there is no click and hold capability, which is particularly useful when performing text selection. The goal is to implement a reliable and intuitive way of performing the click and hold, and hence the Interaction (user experience) Flow is specified in the below slides with detailed diagrams and visuals: https://docs.google.com/presentation/d/1HNhJavxAwGUOFLq3gwac-MFtniLCQka1APofO7gbW_A/edit?usp=sharing

The essence of the idea is the following:

  1. Select click and hold icon from dockbar and look at starting point of where they intend to begin the click and hold.
  2. Zoom box appears and user dwells within it to choose the starting point, and upon dwell completion the zoombox freezes and persists. A tentative starting point is shown with an overlay on top of the zoombox, and 4-way directional controls appear.
  3. The user is able to dwell or click on the 4-way directional controls to adjust the starting point location by 1 mm on the screen with each click.
  4. User selects a button called "Drag" and zoombox and the directional controls disappear. Starting point indicator remains.
  5. User dwells at area of end point, and zoombox appears. The cursor itself has not yet moved from the starting point
  6. User dwells inside zoombox and temporary end-point is shown in the overlay within the zoombox. Dwell completes. The cursor position while left-click is still pressed is moved to the end-point, and the 4-way directional controls are shown to adjust the end-point in real-time.
  7. User selects "done" button. Desired text is now selected and cut, copy, paste operations can be performed.

General note: selecting "None" or another button on the dockbar will cancel the operation if it is in progress. Selecting None once text has been selected will not de-select it.