Egocentric Vision in Assistive Technologies For and By the Blind

Simple item page
dc.contributor.advisorKacorri, Hernisaen_US
dc.contributor.authorLee, Kyungjunen_US
dc.contributor.departmentComputer Scienceen_US
dc.contributor.publisherDigital Repository at the University of Marylanden_US
dc.contributor.publisherUniversity of Maryland (College Park, Md.)en_US
dc.date.accessioned2023-02-02T06:32:04Z
dc.date.available2023-02-02T06:32:04Z
dc.date.issued2022en_US
dc.description.abstractVisual information in our surroundings, such as everyday objects and passersby, is often inaccessible to people who are blind. Cameras that leverage egocentric vision, in an attempt to approximate the visual field of the camera wearer, hold great promise for making the visual world more accessible for this population. Typically, such applications rely on pre-trained computer vision models and thus are limited. Moreover, as with any AI system that augments sensory abilities, conversations around ethical implications and privacy concerns lie at the core of their design and regulation. However, early efforts tend to decouple perspectives, considering only either those of the blind users or potential bystanders. In this dissertation, we revisit egocentric vision for the blind. Through a holistic approach, we examine the following dimensions: type of application (objects and passersby), camera form factor (handheld and wearable), user’s role (a passive consumer and an active director of technology), and privacy concerns (from both end-users and bystanders). Specifically, we propose to design egocentric vision models that capture blind users’ intent and are fine-tuned by the user in the context of object recognition. We seek to explore societal issues that AI-powered cameras may lead to, considering perspectives from both blind users and nearby people whose faces or objects might be captured by the cameras. Last, we investigate interactions and perceptions across different camera form factors to reveal design implications for future work.en_US
dc.identifierhttps://doi.org/10.13016/torq-ew7j
dc.identifier.urihttp://hdl.handle.net/1903/29673
dc.language.isoenen_US
dc.subject.pqcontrolledComputer scienceen_US
dc.subject.pquncontrolledaccessibilityen_US
dc.subject.pquncontrolledartificial intelligenceen_US
dc.subject.pquncontrolledassistive technologyen_US
dc.subject.pquncontrolledblind peopleen_US
dc.subject.pquncontrolledcomputer visionen_US
dc.subject.pquncontrolledhuman-computer interactionen_US
dc.titleEgocentric Vision in Assistive Technologies For and By the Blinden_US
dc.typeDissertationen_US

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Lee_umd_0117E_22976.pdf
Size:
28.06 MB
Format:
Adobe Portable Document Format
Download
(RESTRICTED ACCESS)

Collections

UMD Theses and Dissertations
Computer Science Theses and Dissertations