SmartHMD for Improved Mobility

Overview

The National Eye Institute estimated about 3 million people over age 40 in the US had low vision in 2010 and projects an increase to nearly 5 million in 2030 and 9 million in 2050. Current assistive technologies are a patchwork of mostly low-technology aids with limited capabilities that are often difficult to use, and are not widely adopted. This shortfall in capabilities of assistive technology often stems from lack of a user-centered design approach and is a critical barrier to improve the everyday activities of life (EDAL) and the quality of life (QOL) for individuals with low vision. An intuitive head mounted display (HMD) system on enhancing orientation and mobility (O\&M) and crosswalk navigation, could improve independence, potentially decrease falls, and improve EDAL and QOL. The central hypothesis is that an electronic navigation system incorporating computer vision will enhance O\&M for individuals with low vision. The goal is to develop and validate a smartHMD by incorporating advanced computer vision algorithms and flexible user interfaces that can be precisely tailored to an individual's O\&M need. This project will address the specific question of mobility while the subject crosses a street at a signaled crosswalk. This is a dangerous and difficult task for visually impaired patients and a significant barrier to independent mobility.

This study was originally intended as a single-arm study. Early results and unanticipated events related to component availability made it clear that multiple configurations of the device would be necessary to produce a functional device. Therefore, the study was split into multiple cohorts representing each iteration of the device and testing process, as follows: As the trial progressed, the participants recruited were consistently unable to perform tasks without smartHMD. This is due to the recruitment of participants with severe vision loss. Due to this finding, data was only acquired when participants used the smartHMD when active instead of collecting data with and without the system being active. The participants performed a subset of experiments due to time constraints. Some performed only outdoor trials; some performed only indoor trials; others performed both. The outcome measures depend on which experiments were performed. After the first test involving the initial three participants, the ODG system became unsupported by the company that produced the device. In response, the study team developed a prototype system (RGBD), which was used in the ODG system's place for the remaining tests. The RGBD was initially used indoors with laptop and subsequently outdoors with mobile hardware and new software.