cARdLearner: Using Expressive Virtual Agents when Learning Vocabulary in Augmented Reality

Authors. Aimee Sousa Calepso, Natalie Hube, Noah Berenguel Senn, Vincent Brandt, Michael Sedlmair

Venue. CHI (2022) Late-Breaking Work

Type. Late-Breaking Work

Materials. DOI PDF

Abstract. Augmented reality (AR) has a diverse range of applications, including language teaching. When studying a foreign language, one of the biggest challenges learners face is memorizing new vocabulary. While augmented holograms are a promising means of supporting this memorization process, few studies have explored their potential in the language learning context. We demonstrate the possibility of using flashcard along with an expressive holographic agent on vocabulary learning. Users scan a flashcard and play an animation that is connected with an emotion related to the word they are seeing. Our goal is to propose an alternative to the traditional use of flashcards, and also introduce another way of using AR in the association process.

@inproceedings{10.1145/3491101.3519631,
    title        = {CARdLearner: Using Expressive Virtual Agents When Learning Vocabulary in Augmented Reality},
    author       = {Sousa Calepso, Aimee and Hube, Natalie and Berenguel Senn, Noah and Brandt, Vincent and Sedlmair, Michael},
    year         = {2022},
    booktitle    = {CHI Conference on Human Factors in Computing Systems Extended Abstracts},
    publisher    = {Association for Computing Machinery},
    series       = {CHI EA '22},
    doi          = {10.1145/3491101.3519631},
    url          = {https://doi.org/10.1145/3491101.3519631},
    abstract     = {Augmented reality (AR) has a diverse range of applications, including language teaching. When studying a foreign language, one of the biggest challenges learners face is memorizing new vocabulary. While augmented holograms are a promising means of supporting this memorization process, few studies have explored their potential in the language learning context. We demonstrate the possibility of using flashcard along with an expressive holographic agent on vocabulary learning. Users scan a flashcard and play an animation that is connected with an emotion related to the word they are seeing. Our goal is to propose an alternative to the traditional use of flashcards, and also introduce another way of using AR in the association process.},
    articleno    = {245},
    numpages     = {6},
    keywords     = {contextual learning, augmented reality, language learning}
}