Feasibility and Efficacy of Assisstive Tactile and Auditory Communicating Devices

Overview

This pilot study will integrate multi-sensor fusion techniques (software) to effectively combine information obtained from the newly embedded infrared, ultrasound, and stereo-camera-based sensor systems (hardware) that are implemented into the VIS4ION platform. The core of this technology is based on 4 components: (1) a wearable vest with several distinct range and image sensors embedded. These sensors extract pertinent information about obstacles and the environment, which are conveyed to (2) a haptic interface (belt) that communicates this spatial information to the end-user in real-time via an intuitive, ergonomic and personalized vibrotactile re-display along the torso. (3) A smartphone serves as a connectivity gateway and coordinates the core components through WiFi, bluetooth, and/or 4G LTE, (4) a headset that contains both binaural, open-ear, bone conduction speakers (leaving the ear canal patent for ambient sounds) and a microphone for oral communication-based voice recognition during use of a virtual personal assistant (VPA). Blindfolded-sighted, and blind subjects in a real-world, combined obstacle avoidance / navigation task will serve as an independent measure of overall improvements in the system as well as a roadmap for future avenues to enhance performance. Further, a prospective, randomized crossover, controlled, non-blinded phase will be conducted in Thailand as part of this study to compare and evaluate effectiveness of the wearable vest for increasing navigation and quality of life.

Investigators will try to develop algorithms that will recognize multiple objects and persons in real-time (enhanced scene interpretation for multi-object identification). And based on that, human-centered simulation trials and experiments for feasibility and efficacy of the platform's tactile and auditory 'communication' outputs will be conducted. Finally auditory and tactile 'prompts' (system output) based on the end user's immediate needs based on initial testing results, will be integrated into the platform. Additional activities will occur at the Thailand site. In the second phase, an improved system will be tested in an extended-use experiment, detecting for health-related changes in our participants (increased mobility and QoL). The study team will further test the generalizability of the new mapping technology in a more challenging environment, testing system performance using metrics, comparing results between current and previous systems.