VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual Reality

Authors. Markus Wieland, Michael Sedlmair, Tonja-Katrin Machulla

Venue. CHI (2023) Extended Abstract

Type. Extended Abstract

Materials. DOI ACM PDF video

Abstract. As social virtual reality (VR) becomes more popular, avatars are being designed with realistic behaviors incorporating non-verbal cues like eye contact. However, perceiving eye contact during a onversation can be challenging for people with visual impairments. VR presents an opportunity to display eye contact cues in alternative ways, making them perceivable for people with visual impairments. We performed an exploratory study to gain initial insights on designing eye contact cues for people with visual impairments, including a focus group for a deeper understanding of the topic. We implemented eye contact cues via visual, auditory, and tactile sensory modalities in VR and tested these approaches with eleven participants with visual impairments and collected qualitative feedback. The results show that visual cues indicating the gaze direction were preferred, but auditory and tactile cues were also prevalent as they do not superimpose additional visual information.

@inproceedings{10.1145/3544549.3585726,
    title        = {VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across Different Sensory Modalities for People with Visual Impairments in Virtual Reality},
    author       = {Wieland, Markus and Sedlmair, Michael and Machulla, Tonja-Katrin},
    year         = {2023},
    booktitle    = {Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems},
    publisher    = {Association for Computing Machinery},
    series       = {CHI EA '23},
    doi          = {10.1145/3544549.3585726},
    url          = {https://doi.org/10.1145/3544549.3585726},
    abstract     = {As social virtual reality (VR) becomes more popular, avatars are being designed with realistic behaviors incorporating non-verbal cues like eye contact. However, perceiving eye contact during a conversation can be challenging for people with visual impairments. VR presents an opportunity to display eye contact cues in alternative ways, making them perceivable for people with visual impairments. We performed an exploratory study to gain initial insights on designing eye contact cues for people with visual impairments, including a focus group for a deeper understanding of the topic. We implemented eye contact cues via visual, auditory, and tactile sensory modalities in VR and tested these approaches with eleven participants with visual impairments and collected qualitative feedback. The results show that visual cues indicating the gaze direction were preferred, but auditory and tactile cues were also prevalent as they do not superimpose additional visual information.},
    articleno    = {313},
    numpages     = {6},
    keywords     = {eye contact, assistive technology, visual impairment, social virtual reality}
}