Emotionally Adaptive Virtual Health Assistants for Enhanced Social Presence and Trust
Ashrafi, N., Schorlemmer, J., Vona, F., Kojic, T., Hillmann, S., Braytee, A., Wang, Y.-K., Kocaballi, B., Moreira, C. P., Möller, S. & Voigt-Antons, J.-N.
Paper presented at the first workshop on Designing Safe and Effective Intelligent Virtual Agents (IVAs) for Health Care: Risks, Benefits, and Best Practices (DESIGN IVA HC 2025), Berlin, Germany
Abstract
The integration of emotional intelligence into virtual health assistance systems has the potential to revolutionize the way users interact with healthcare applications.By adapting to users' emotional states, virtual characters or avatars can provide more personalized and engaging interactions, leading to improved user satisfaction and overall well-being.This study presents the development of photorealistic virtual assistants using Unreal Engine's Metahuman Creator, which can adapt their speech and facial expressions to match the user's emotional state.The system, which synchronizes Metahuman avatars with an AI-powered chatbot, enables the display of emotions such as happiness, excitement, boredom, and sadness, creating a more natural and engaging conversation.A user study with 21 participants evaluated the system's effectiveness, revealing that emotion-adaptive avatars notably enhance experience quality and emotional engagement compared to neutral virtual assistants.The findings of this study have significant implications
Cite as
Ashrafi, N., Schorlemmer, J., Vona, F., Kojic, T., Hillmann, S., Braytee, A., Wang, Y.-K., Kocaballi, B., Moreira, C. P., Möller, S. & Voigt-Antons, J.-N. (2025, September). Emotionally Adaptive Virtual Health Assistants for Enhanced Social Presence and Trust. Paper presented at the first workshop on Designing Safe and Effective Intelligent Virtual Agents (IVAs) for Health Care: Risks, Benefits, and Best Practices (DESIGN IVA HC 2025), Berlin, Germany.
