MRLingo: A Mixed Reality Approach for Situated Vocabulary Learning

Abstract. We present MRLingo, a mixed reality vocabulary learning approach that uses real-time object recognition to offer vocabulary acquisition. MRLingo runs dynamically in real-life contexts, offering more flexibility than traditional devices like smartphones and desktops. Likewise, MRLingo offers visual word translations, audio pronunciation, and quizzes, reinforcing vocabulary memorization. A user study was conducted to evaluate the effectiveness of MR-Lingo and compare it with a desktop-based prototype. Results show that MRLingo significantly outperforms engagement and usability, though challenges remain in cluttered or occluded contexts.