Detection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accent

dc.contributor.authorGordon-Salant, Sandra
dc.contributor.authorSchwartz, Maya
dc.contributor.authorOppler, Kelsey
dc.contributor.authorYeni-Komshian, Grace
dc.date.accessioned2022-01-03T21:07:41Z
dc.date.available2022-01-03T21:07:41Z
dc.date.issued2022-01
dc.description.abstractThis investigation examined age-related differences in auditory-visual (AV) integration as reflected on perceptual judgments of temporally misaligned AV English sentences spoken by native English and native Spanish talkers. In the detection task, it was expected that slowed auditory temporal processing of older participants, relative to younger participants, would be manifest as a shift in the range over which participants would judge asynchronous stimuli as synchronous (referred to as the “AV simultaneity window”). The older participants were also expected to exhibit greater declines in speech recognition for asynchronous AV stimuli than younger participants. Talker accent was hypothesized to influence listener performance, with older listeners exhibiting a greater narrowing of the AV simultaneity window and much poorer recognition of asynchronous AV foreign-accented speech compared to younger listeners. Participant groups included younger and older participants with normal hearing and older participants with hearing loss. Stimuli were video recordings of sentences produced by native English and native Spanish talkers. The video recordings were altered in 50 ms steps by delaying either the audio or video onset. Participants performed a detection task in which the judged whether the sentences were synchronous or asynchronous, and performed a recognition task for multiple synchronous and asynchronous conditions. Both the detection and recognition tasks were conducted at the individualized signal-to-noise ratio (SNR) corresponding to approximately 70% correct speech recognition performance for synchronous AV sentences. Older listeners with and without hearing loss generally showed wider AV simultaneity windows than younger listeners, possibly reflecting slowed auditory temporal processing in auditory lead conditions and reduced sensitivity to asynchrony in auditory lag conditions. However, older and younger listeners were affected similarly by misalignment of auditory and visual signal onsets on the speech recognition task. This suggests that older listeners are negatively impacted by temporal misalignments for speech recognition, even when they do not notice that the stimuli are asynchronous. Overall, the findings show that when listener performance is equated for simultaneous AV speech signals, age effects are apparent in detection judgments but not in recognition of asynchronous speech.en_US
dc.description.sponsorshipNational Institute on Aging, NIH, grant # R01 AG009191, awarded to the first authoren_US
dc.description.urihttps://doi.org/10.3389/fpsyg.2021.772867
dc.identifierhttps://doi.org/10.13016/iwmd-dvux
dc.identifier.urihttp://hdl.handle.net/1903/28269
dc.relation.isAvailableAtCollege of Behavioral & Social Sciencesen_us
dc.relation.isAvailableAtHearing & Speech Sciencesen_us
dc.relation.isAvailableAtDigital Repository at the University of Marylanden_us
dc.relation.isAvailableAtUniversity of Maryland (College Park, MD)en_us
dc.rightsCC0 1.0 Universal*
dc.rights.urihttp://creativecommons.org/publicdomain/zero/1.0/*
dc.subjectauditory- visual speech perceptionen_US
dc.subjectaging
dc.subjecthearing loss
dc.subjectforeign-accented speech
dc.subjectdetection of asynchronous auditory-visual speech
dc.subjectrecognition of asynchronous auditory-visual speech
dc.titleDetection and Recognition of Asynchronous Auditory/Visual Speech: Effects of Age, Hearing Loss, and Talker Accenten_US
dc.typeDataseten_US

Files

Original bundle
Now showing 1 - 3 of 3
No Thumbnail Available
Name:
ReadMe.txt
Size:
2.33 KB
Format:
Plain Text
Description:
No Thumbnail Available
Name:
Recognition trial by trial_combined.csv
Size:
1.42 MB
Format:
Unknown data format
Description:
Recognition data file
No Thumbnail Available
Name:
Detection trial by trial_combined.csv
Size:
1.32 MB
Format:
Unknown data format
Description:
Detection data file
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.57 KB
Format:
Item-specific license agreed upon to submission
Description: