Estimating reliability for response-time difference measures: Toward a standardized, model-based approach

Simple item page
dc.contributor.authorHui, Bronson
dc.contributor.authorWu, Zhiyi
dc.date.accessioned2023-09-19T16:03:37Z
dc.date.available2023-09-19T16:03:37Z
dc.date.issued2023-05-29
dc.description.abstractA slowdown or a speedup in response times across experimental conditions can be taken as evidence of online deployment of knowledge. However, response-time difference measures are rarely evaluated on their reliability, and there is no standard practice to estimate it. In this article, we used three open data sets to explore an approach to reliability that is based on mixed-effects modeling and to examine model criticism as an outlier treatment strategy. The results suggest that the model-based approach can be superior but show no clear advantage of model criticism. We followed up these results with a simulation study to identify the specific conditions in which the model-based approach has the most benefits. Researchers who cannot include a large number of items and have a moderate level of noise in their data may find this approach particularly useful. We concluded by calling for more awareness and research on the psychometric properties of measures in the field.
dc.description.urihttps://doi.org/10.1017/S027226312300027X
dc.identifierhttps://doi.org/10.13016/dspace/btn2-zcrv
dc.identifier.citationHui, B., & Wu, Z. (2023). Estimating reliability for response-time difference measures: Toward a standardized, model-based approach. Studies in Second Language Acquisition, 1-24.
dc.identifier.urihttp://hdl.handle.net/1903/30541
dc.language.isoen_US
dc.publisherCambridge University Press
dc.relation.isAvailableAtCollege of Arts & Humanitiesen_us
dc.relation.isAvailableAtLanguages, Literatures, & Culturesen_us
dc.relation.isAvailableAtDigital Repository at the University of Marylanden_us
dc.relation.isAvailableAtUniversity of Maryland (College Park, MD)en_us
dc.titleEstimating reliability for response-time difference measures: Toward a standardized, model-based approach
dc.typeArticle
local.equitableAccessSubmissionNo

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
estimating-reliability-for-response-time-difference-measures-toward-a-standardized-model-based-approach.pdf
Size:
558.53 KB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.55 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Languages, Literatures, & Cultures Research Works