Windows into Sensory Integration and Rates in Language Processing: Insights from Signed and Spoken Languages

dc.contributor.advisorIdsardi, William J.en_US
dc.contributor.authorHwang, So-One K.en_US
dc.contributor.departmentLinguisticsen_US
dc.contributor.publisherDigital Repository at the University of Marylanden_US
dc.contributor.publisherUniversity of Maryland (College Park, Md.)en_US
dc.date.accessioned2012-02-17T06:33:14Z
dc.date.available2012-02-17T06:33:14Z
dc.date.issued2011en_US
dc.description.abstractThis dissertation explores the hypothesis that language processing proceeds in "windows" that correspond to representational units, where sensory signals are integrated according to time-scales that correspond to the rate of the input. To investigate universal mechanisms, a comparison of signed and spoken languages is necessary. Underlying the seemingly effortless process of language comprehension is the perceiver's knowledge about the rate at which linguistic form and meaning unfold in time and the ability to adapt to variations in the input. The vast body of work in this area has focused on speech perception, where the goal is to determine how linguistic information is recovered from acoustic signals. Testing some of these theories in the visual processing of American Sign Language (ASL) provides a unique opportunity to better understand how sign languages are processed and which aspects of speech perception models are in fact about language perception across modalities. The first part of the dissertation presents three psychophysical experiments investigating temporal integration windows in sign language perception by testing the intelligibility of locally time-reversed sentences. The findings demonstrate the contribution of modality for the time-scales of these windows, where signing is successively integrated over longer durations (~ 250-300 ms) than in speech (~ 50-60 ms), while also pointing to modality-independent mechanisms, where integration occurs in durations that correspond to the size of linguistic units. The second part of the dissertation focuses on production rates in sentences taken from natural conversations of English, Korean, and ASL. Data from word, sign, morpheme, and syllable rates suggest that while the rate of words and signs can vary from language to language, the relationship between the rate of syllables and morphemes is relatively consistent among these typologically diverse languages. The results from rates in ASL also complement the findings in perception experiments by confirming that time-scales at which phonological units fluctuate in production match the temporal integration windows in perception. These results are consistent with the hypothesis that there are modality-independent time pressures for language processing, and discussions provide a synthesis of converging findings from other domains of research and propose ideas for future investigations.en_US
dc.identifier.urihttp://hdl.handle.net/1903/12201
dc.subject.pqcontrolledLinguisticsen_US
dc.subject.pqcontrolledCognitive psychologyen_US
dc.subject.pqcontrolledNeurosciencesen_US
dc.subject.pquncontrolledintelligibilityen_US
dc.subject.pquncontrolledsign languageen_US
dc.subject.pquncontrolledspeechen_US
dc.subject.pquncontrolledtemporal integrationen_US
dc.titleWindows into Sensory Integration and Rates in Language Processing: Insights from Signed and Spoken Languagesen_US
dc.typeDissertationen_US

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Hwang_umd_0117E_12636.pdf
Size:
4.44 MB
Format:
Adobe Portable Document Format