Listening Effort in Cochlear Implant Users

Overview

People with hearing loss experience extra effort when listening, which can lead to severe psychological barriers to communication and social participation. Listening effort can lead to fatigue, mental strain, burnout, medical sick leave, and the need for increased time to recover from regular daily activities. This proposal aims to understand effort changes on a moment-to-moment basis during listening, how long the effort lasts, and how the planning and execution of effort is impacted by the experience of using a cochlear implant.

General methods: Speech recognition testing: The main experimental task is listening to speech in the free field in a sound-attenuated booth. Traditional speech recognition consists of hearing and repeating sentences, and these studies will vary on that general theme with modifications to suit the specific aims of the project. For example, some stimuli are repeated twice before verbal response, and some are questions and answers rather than declarative sentences. The investigators have developed the stimuli specifically for each experiment, always avoiding emotionally evocative stimuli since they can have large effects on pupil dilation. Intelligibility: The investigators will track percent-correct scores for whole sentences and words within each sentence. The investigators also track the position of mistakes during the sentence (e.g. first word, last word), and whether the participant's response could feasibly be a sensible utterance, or whether it lacks any coherent meaning, because this factor has such a large effect on listening effort. The investigators will test normal-hearing (NH, or TH Typical Hearing) listeners' perception of both regular speech and vocoded speech, allowing us to separately examine the influence of signal degradation separately from the chronic experience of hearing difficulty. Pupillometry: During speech recognition tests, changes in the participant's pupil size will be monitored by an Eyelink eye tracker placed 50 cm from the eyes. Phasic pupil dilations are linked with experiment timing landmarks interpreted as changes in listening effort, based on numerous published studies Non-auditory tasks: The investigators will administer the NASA task load index (TLX) to gauge the participant's subjective experience of five dimensions of effort during listening tasks. The investigators will administer the NIH Toolbox Pattern Comparison Processing Speed Test. The investigators will explore participants' ability to inhibit irrelevant information using a modified Flanker developed by Xie et al. (2017), which compares interference inhibition, rule inhibition, and response inhibition, using carefully structured sequences of the flanker where the rules of responses change at strategic moments during testing. The investigators will also implement a local-global attentional switch task using the approach described by Peristeri et al. (2020). Experiment 1A: The investigators will test the ability to prepare extra effort in a study where the listener knows in advance whether an upcoming stimulus will be easier or harder to understand. Each trial begins with a cue of "easy" or "hard" displayed in text on the screen. Following a four-second delay to let the pupils return to baseline, the sentence is played. Pupil dilation is tracked throughout the entire trial, with the crucial differences being examined between the text signal and the onset of the speech, reflecting the listener's momentary preparation of extra effort. Importantly, the easy and hard trials are randomly intermixed rather than blocked, so that the elicited effort specifically reflects momentary preparation rather than a long-term disposition. Experiment 2A: This task simulates a misperception of a word during a sentence, with an opportunity to hear a repetition of the sentence to clarify that word. In each trial, a sentence is played twice. In the first presentation, the sentence is either fully intact (normal), or has a single word replaced by noise. The sentences are constructed so that the word is essential to the meaning of the sentence, but cannot be recovered by context. In the second presentation, the sentence is always fully intact, enabling restoration of the missing word. Experiment 2B: This task simulates a situation where a listener withholds effort until relevant information arrives. Participants will complete a standard sentence repetition task, but with two different kinds of response: they either repeat the full sentence, or they repeat only the final word. Experiment 3A: Judging answers to questions. In each trial, the participant hears a question (Q) and an answer (A) spoken by a different talker, as for a conversational dyad. The participant is prompted to respond with "yes" (the answer was correct) or "no" (the answer was not correct).The answer can be either correct, incorrect, or completely unexpected (nonsense), randomly varying trial to trial. The nonsense answers invite a moment of second-guessing the perception since they are so unexpected. Experiment 3B: This is similar to experiment 3A, but instead of completely unexpected answers, the listener will hear an answer that is related to the question, inviting a reassessment of whether the question was heard correctly. For example, "What color is a basketball? Round" would invite the listener to momentarily doubt whether the question was understood correctly. Experiment 3C: This experiment simulates the confusion from hearing emphasis on the wrong word. On each trial, participants hear a sequence of a question and then a full-sentence answer that contains emphasis on a single word. The answer either has appropriate emphasis on the word that directly answers the question, or unexpected emphasis on an unimportant word that was already in the question. Experiment 3D: The reliance on post-sentence effort will be examined in a behavioral study where listeners hear a continuous stream of sentences and can manually adjust the rate of speech (manipulated using the pitch-synchronous overlap-add PSOLA algorithm in Praat) until arriving at a comfortable pace.