Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

Gordon-Salant, Sandra; Schwartz, Maya; Oppler, Kelsey; Yeni-Komshian, Grace

Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

dc.contributor.author	Gordon-Salant, Sandra
dc.contributor.author	Schwartz, Maya
dc.contributor.author	Oppler, Kelsey
dc.contributor.author	Yeni-Komshian, Grace
dc.date.accessioned	2022-01-03T21:07:41Z
dc.date.available	2022-01-03T21:07:41Z
dc.date.issued	2022-01
dc.description.abstract	This investigation examined age-related differences in auditory-visual (AV) integration as reflected on perceptual judgments of temporally misaligned AV English sentences spoken by native English and native Spanish talkers. In the detection task, it was expected that slowed auditory temporal processing of older participants, relative to younger participants, would be manifest as a shift in the range over which participants would judge asynchronous stimuli as synchronous (referred to as the “AV simultaneity window”). The older participants were also expected to exhibit greater declines in speech recognition for asynchronous AV stimuli than younger participants. Talker accent was hypothesized to influence listener performance, with older listeners exhibiting a greater narrowing of the AV simultaneity window and much poorer recognition of asynchronous AV foreign-accented speech compared to younger listeners. Participant groups included younger and older participants with normal hearing and older participants with hearing loss. Stimuli were video recordings of sentences produced by native English and native Spanish talkers. The video recordings were altered in 50 ms steps by delaying either the audio or video onset. Participants performed a detection task in which the judged whether the sentences were synchronous or asynchronous, and performed a recognition task for multiple synchronous and asynchronous conditions. Both the detection and recognition tasks were conducted at the individualized signal-to-noise ratio (SNR) corresponding to approximately 70% correct speech recognition performance for synchronous AV sentences. Older listeners with and without hearing loss generally showed wider AV simultaneity windows than younger listeners, possibly reflecting slowed auditory temporal processing in auditory lead conditions and reduced sensitivity to asynchrony in auditory lag conditions. However, older and younger listeners were affected similarly by misalignment of auditory and visual signal onsets on the speech recognition task. This suggests that older listeners are negatively impacted by temporal misalignments for speech recognition, even when they do not notice that the stimuli are asynchronous. Overall, the findings show that when listener performance is equated for simultaneous AV speech signals, age effects are apparent in detection judgments but not in recognition of asynchronous speech.	en_US
dc.description.sponsorship	National Institute on Aging, NIH, grant # R01 AG009191, awarded to the first author	en_US
dc.description.uri	https://doi.org/10.3389/fpsyg.2021.772867
dc.identifier	https://doi.org/10.13016/iwmd-dvux
dc.identifier.uri	http://hdl.handle.net/1903/28269
dc.relation.isAvailableAt	College of Behavioral & Social Sciences	en_us
dc.relation.isAvailableAt	Hearing & Speech Sciences	en_us
dc.relation.isAvailableAt	Digital Repository at the University of Maryland	en_us
dc.relation.isAvailableAt	University of Maryland (College Park, MD)	en_us
dc.rights	CC0 1.0 Universal	*
dc.rights.uri	http://creativecommons.org/publicdomain/zero/1.0/	*
dc.subject	auditory- visual speech perception	en_US
dc.subject	aging
dc.subject	hearing loss
dc.subject	foreign-accented speech
dc.subject	detection of asynchronous auditory-visual speech
dc.subject	recognition of asynchronous auditory-visual speech
dc.title	Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent	en_US
dc.type	Dataset	en_US