Quandt, L. C., Lamberton, J., Willis, A. S.^, Wang, J., Weeks, K.*, Kubicek, E.^, & Malzkuhn, M. (2020). Teaching ASL signs using signing avatars and immersive learning in virtual reality. The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’20), 98, 1-4. DOI: 10.1145/3373625.3418042
We present here a new system, in which signing avatars (computer-animated virtual humans built from motion capture recordings) teach introductory American Sign Language (ASL) in an immersive virtual environment. The system is called Signing Avatars & Immersive Learning (SAIL). The significant contributions of this work are 1) the use of signing avatars, built from state-of-the-art motion capture recordings of a native signer; 2) the integration with LEAP gesture tracking hardware, allowing the user to see his or her own movements within the virtual environment; 3) the development of appropriate introductory ASL vocabulary, delivered in semi-interactive lessons; and 4) the 3D environment in which a user accesses the system.