XiyueWang-Miraikan
commented
1 year ago STUDY 1: INITIAL EXPLORATION
Goal: To understand
- Which interaction strategies are most natural for BLV users of I3Ms
- Their preferred level of model agency
Approach
- Each model
- Explored by at least two different participants
- Shown in both a low-agency and high-agency mode
- Agency (a WoZ method-ology with a ‘wizard’ providing auditory output on behalf of the model)
- Low-agency: feedback was provided by the wizard only when deliberately initiated by the participant
- a participant indicates that when they tap the model they expect an auditory description or haptic vibration
- High-agency: the wizard played a more proactive role, providing richer assistance
- introducing the model when first touched
- intervening if the participant experienced difficulty during the experiment
- Participants were asked to verbalise any deliberate actions they made using the ‘think-aloud’ protocol [51]
Results
- From both observation of the participant’s interaction with the models AND responses to the questions probing their behavior
- Preferred Interaction Techniques
- First, touch - initial exploration, identify what it is
- Next, other interaction techniques emerge after becoming comfortable
- Gesture. E.g. Double-tap
- Voice command
- Multi-modal. E.g. Route-finding
- Preferred Output Modalities
- Verbal: Most common
- haptic: Quicker guidance, confirmation
- Exploration and Task Completion Strategies
- Scanning model boundaries -> systematically exploring the different parts or areas
- Use touch as much as possible
- Influence of Prior Experience
- Design Choices
- Agency and Independence
STUDY 2: VALIDATION
Links
Abstract
While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use when exploring I3Ms, and investigated their attitudes towards different levels of model agency. These findings informed the creation of an I3M prototype of the solar system. A second user study with this model revealed a hierarchy of interaction, with BLV users preferring tactile exploration, followed by touch gestures to trigger audio labels, and then natural language to fill in knowledge gaps and confirm understanding.