Redeveloping ARCADE: User Experience with Personalized Conversational MetaHuman Avatars at Human Scale in Immersive Environments
Ashrafi, N., Spang, R. P., Vona, F., Henning, J., Möller, S. & Voigt-Antons, J.-N.
Paper presented at the International Conference on Human-Computer Interaction (HCII 2026), Montreal, Canada, July 2026
Summary
Inspired by the original ARCADE project, this work presents a framework for deploying life-sized, highly realistic conversational avatars in physical environments. The approach combines 3D facial scanning, mesh refinement, and Unreal Engine 5.5 MetaHuman technology to create personalized digital twins, paired with the Convai platform for natural language understanding and open-ended dialogue. A custom hardware setup with a ceiling-mounted projector and a suspended plexiglass back-projection screen creates the illusion of a physically present digital human. Engineering and design challenges such as projection geometry, audio capture, avatar personality profiling, and cross-platform integration are addressed, with the goal of enhancing perceived social presence and engagement for events, education, institutional communication, and healthcare scenarios.
Written for this site, the published abstract is at the DOI.
Cite as
Ashrafi, N., Spang, R. P., Vona, F., Henning, J., Möller, S. & Voigt-Antons, J.-N. (2026, July). Redeveloping ARCADE: User Experience with Personalized Conversational MetaHuman Avatars at Human Scale in Immersive Environments. Paper presented at the International Conference on Human-Computer Interaction (HCII 2026). Montreal, Canada.
