Show and Tell: Exploring how audio narratives can complement visualizations of stroke survivors’ personal health data

Abstract

Wearable technology in healthcare could give individuals awareness and independence in rehabilitation. In this qualitative work, I investigate how using speech-based, audio narrative summaries alongside graphical visualizations affect users’ understanding of their personal data. I conducted this work in the context of stroke recovery, where stroke survivors experiencing hemiparesis can monitor their physical progress using a wearable ring sensor. Using a co-design approach, I engaged with stroke survivors and their caregivers to elicit recommendations for multimodal (speech/visual) feedback of the wearable ring data. Reflexive thematic analysis of the sessions showed that multimodal feedback can potentially lend therapeutic support for stroke survivors. Audio narratives helped to reinforce the visual feedback, and positively framed narrative content that was reflective, motivational, and suggestive was able to support stroke survivors as they navigate their independent recovery journeys.